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CHAPTER 11 


THE ALGORITHMS OF SUMMARISATION 


11.00 INTRODUCTION 


In VoL. I our main concern has been with problems involving comparison of scores of not 
more than 2 samples from the same universe or from identical universes. When this is the 
end in view, the score may be: (a) the mean or total value of a count (e.g. income) or measure- 
ment (e.g. height) attached to each individual of the group ; (b) the proportion or number of 
individuals with a particular attribute. Whenever we have so far used the method of scoring 
last mentioned, we have done so on the understanding that the constituent individuals of 
the group are assignable to one of two classes A or not-A. We have not examined the 
consequences of any null hypothesis when: (a) our definition of sample structure entails a 
specification of individuals assignable to more than 2 classes; (b) our comparison of samples 
involves more than two of them at a time. Such are the issues we shall chiefly explore in this 
volume. 

In doing so, we shall acquaint ourselves with different statistical techniques which have much 
in common, though their uses may be greatly different. What is common ground may be 
referable to the logic of classifying and summarising the relevant data or to the algebra of the 
sampling distributions invoked as a basis for significance tests. For that reason, we shall not 
attempt to deal comprehensively with any one of them as a separate entity in the chapters which 
follow; and a brief summary of the lay-out of this volume may therefore be helpful to the 
beginner who wishes to make the best use of it. 

The only theoretical sampling distribution we have so far employed as a basis for a signifi- 
cance test is the normal ; but we have seen that the reasons for relying on the normal distribution 
in one context may be quite different from the reasons for relying on it in another. For instance, 
different reasons justify our belief that the normal curve gives in practice a good enough 
description for specifying the frequency of different possible values of: (a) the mean score of 100 
tosses of a die ; (b) the difference between the proportion of hearts in samples of 50 and 75 cards 
taken from a full pack with replacement of each card drawn before extraction of another. Similar 
remarks apply to the use of the sampling distributions invoked by the statistical techniques 
dealt with in this volume. "Thus the reasons for performing a Chi-Square Test, i.e. a test based 
on a special form of Pearson's Type ПІ, or the reasons for performing a ¢-Test, i.e. a test based 
on a special form of Pearson's Type VII, will depend on the character of the statistic whose 
sampling distribution is under consideration ; but we are in a position to grasp what the reasons 
are only if we have some acquaintance with the algebraic properties of Pearson's Type III or 
"Type VII, as the case may be. 

For this reason, and especially because of a common pattern to which Pearson's Types 
conform, it will be convenient to deal with significance tests in a sequence of three chapters 
(14-16) rather than to set forth the rationale of a test appropriate to a particular statistical pro- 
cedure in the same context as the exposition of the terms of reference of the latter. All the new 
tests we shall meet do in fact come within the compass of Pearson’s system of which we had a 
preview in Chapter 6, being referable to Types I-III, VI and VII. If we recognise this at the 
outset, it will be possible to understand the relevance of each to the statistical procedure which 
invokes it without recourse to considerations derived from the geometry of hyperspace, or 
the use of matrix algebra. The standpoint of the author is that a statistical test based on 

I * 
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the assumption of a continuous score distribution is merely a device based on curve-fitting, 
and as such is at best an approximate description of the real world. From the standpoint 
of the student who is not a trained mathematician it is therefore fortunate that Pearson's system 
of curve-fitting by moments anticipates so many of the requirements of subsequent theory. 
Hence the chapters dealing with significance tests start with an elementary exposition of the 
properties of moments and a review of Pearson's type system in so far as it is pertinent to the 
end in view. 

As stated, the several statistical procedures dealt with below have in common that they call 
for methods more elaborate than those employed in classifying and summarising quantitative 
data relevant to the issues dealt with in Vol. I; and it is easy for the beginner to confuse two 
different aims which may converge in the exposition of the algebraic rationale of any one of them. 
One is to specify certain relations—which we may speak of as tautologies—between numbers set 
out in a particular framework of classification, their truth having as such no necessary connexion 
with the theory of probability. The other is to construct summarising indices which have 
properties consonant with the requirements of sampling theory. The two aims overlap. For 
the interpretation of tautologies suggestive of an index whose sampling distribution is specifiable 
—or approximately specifiable—is essential to an understanding of the use of a statistical method, 
if only because its use depends on what information it summarises. 

At this stage, the last remarks may not be clear to the reader as yet unaware that it is rarely 
profitable to read a book by starting at the beginning and continuing to the end. The author 
can merely hope that some will return to our last words after a first quick perusal. Here it must 
suffice to say that there is common ground in the task of summarising data for very different 
statistical techniques which employ several criteria of classification, and hence of making the 
logical assumptions inherent in their credentials. Consequently, we shall start (in this chapter) 
with the exposition of notations which have no other justification than to reduce the effort 
involved in recognising some purely formal relations between numerical data when assembled in 
a particular way. Against this background, we shall examine (Chapters 12-13) the rationale 
of two statistical procedures without reference to what tests we appropriately invoke when 
applying them. 


11.01 THREE TYPES or Grip 


Ir may first be helpful if we clarify two arbitrary levels of classification, which we may distin- 
guish as uni-dimensional and multi-dimensional. In the first category we include : (a) classifying 
a population (universe or sample) by stating how many or what proportion of individuals belong 
to a particular class distinguished by some attribute specifiable in either explicitly quantitative 
terms (e.g. tall, meaning 5 ft. 7 in. or over, or anaemic, meaning with an erythrocyte count of less 
than three million per cu. mm. of blood) or qualitative terms (e.g. yellow, Protestant, naturalised 
American) ; (b) classifying a population on some uniform scale as by stating how many individuals 
(at a given time) have a body temperature of such and such by intervals of one-tenth of a degree 
Fahrenheit, or an income of such and such by intervals of £50 per annum. In contra-distinction 
to the above the simplest sort of multi-dimensional classification (i.e. a 2-dimensional) arises 
when 


(i) we can assign to every individual of a population two scores (e.g. height and weight, 
or earned and unearned income) ; 


(ii) we can state how many members of each of one exclusive set of sub-populations (e.g. 
Protestant, Catholic, Greek Orthodox, Other) are assignable to another of a second 
exclusive set (e.g. American-born, Naturalised, Other) ; 
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(iii) we can assign to every individual (or group) a score value (e.g. blood calcium level or 
milk yield) on a 1-dimensional scale, and can assign each individual (or group) to one 
of two or more exclusive sets of sub-populations (e.g. urban and rural, tuberculous 
and healthy). 


The questions which prompt us to classify data in one or other way referred to in the 
preceding paragraph are various ; but our method of assembling our data depends as much on 
the nature of the data as on the nature of the question. Inherent in any method we adopt are 
certain relations implicit in the method itself; and our preliminary task in this chapter will be 
to examine the problem of summarising data to bring into focus such relations aside from any 
utility they may prove to have from the standpoint of statistical theory. Corresponding to 
each of the 3 types of 2-dimensional classification we may thus prescribe as the first step in 
the summarisation of our numerical data a particular method of tabulation, i.e. a grid-wise lay-out. 

For case (i) which we speak of as the bivariate population, it takes the form shown below as 
а score-frequency (more briefly, frequency) grid. The explicit (n;;) in each grid cell is the 
number or proportion of individuals with a unique combination of A-scores and B-scores as 
indicated by the entries at the head of each column and row. To each cell we can therefore 
assign a score function of an A-score (a,) alone (e.g. аў), of a B-score (b;) alone (e.g. bj) or of both 
(e.g. а). The reader of Volume I has made the acquaintance of this lay-out in Chapters 8-9. 


Border scores а а ds 


'The important peculiarity of the frequency (or correlation) grid is that each dimension 
carries a set of border-scores which collectively specify the criterion of sub-classification (e.g. 
height) in that dimension, and the notation makes sufficiently explicit the corresponding frequency 
of the cell-score under consideration. For example, we may be interested in the distribution 
of score products of the form ajbj. If so, we can write down the frequency of the particular 
product a3b? as the value of лу shown in the table. 

The appropriate lay-out for data specified as case (ii) above is the contingency grid : 


Protestant Catholic Greek Other TOTAL 
American-born Noo Tho Nao пу N.o 
Naturalised Tor My Nay Nay Nui 
Other поз тз паз пу N.a 
TOTAL Ne | N. Ne Ns. N 


The totals set out here have a special importance, because it is implicit in the structure of 
a true contingency table that we can specify the number or proportion of individuals in each 
of the B-classes (here national status) assignable to any one of the A-classes (here religious faith). 
"Thus the column totals (N;.), row totals (N, ;) and the grand total (N) аге all fixed. It follows from 
this that we can fill in any cell of a row or any cell of a column, by deduction of the residual total, 
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if we know the entries for all the other cells of the same row or column. In a grid of r rows and 
c columns (i.e. rc cells excluding the column and row totals), there are thus c redundant row 
entries and r redundant column entries, and in all r + c — 1 redundant entries, since the last 
cell of the last row and the last column is common to both. Hence the number of cell entries 
we require to know before we can complete the table is rc — (r + c — 1) = (r — 1)(с — 1). 
"This restriction distinguishes what we here call a true contingency table from a lay-out 
which is superficially like it. Following Mendel опе may classify pea plants exclusively by seed- 
coat as yellow or green and exclusively by stature as tall or short. All we may happen to know 
about the possible structure of a sample of N plants we may then set out in one dimension as 


"Tall. Short. "Total. 


Green. Yellow. Green. Yellow. 


d = (N-a-b-o) N 


"Tall Short 


Green c 


Yellow d = (N-a-b-c) 


"Total N | 


A spurious contingency table of this sort summarises the possibilities rather than the actualities 
of an N-fold population structure; and the reader will note that we require to know rc — 1 
cell entries before we can complete it in the absence of the additional information our row and 
column totals of a true contingency table supply. 

The two kinds of tabulation schematised in the foregoing remarks have this in common 
that the explicit cell entries are absolute or relative frequencies, i.e. proportions or numbers of 
individuals. For data specified as case (iii) above, the appropriate lay-out is a grid of which 
the cell entries are scores. If we have only one qualitative criterion of classification the score- 
grid is merely a set of scores laid out in any order within columns referable to all-or-none 
classes ; we can set out data classifiable w.r.t. more than one qualitative criterion as below. 
Here the cell entries (x;;) are scores referable to individual members of the population or 
groups of individuals specified as members of one or other class of 2 different sets as indicated 
by labelling the rows and columns. ‘Thus we may be able exclusively and simultaneously to 
assign the fertility rates (ху) of- groups which share the same religious faith and groups 
distinguished by national status, as below : 


Protestant Catholic Other 
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The student will note that we have added no entries for score totals at the foot of the columns 
or margin of the rows. Nor would the addition of such information dispense with the need to 
make every cell entry explicit, unless we also knew how many individuals each sub-population 
contains. In what follows we shall explore relations between numerical characteristics of sub- 
populations classified in 2 or more dimensions with special reference to the correlation grid 
(11.02-11.04) and the score-grid (11.05). 


Relation Between Score-Grid and Correlation Grid 


As pointed out (p. 408) in Chapter 10 and illustrated in Fig. 83 of Vol. I, it is not possible 
to convert a score-grid exhibiting two different criteria of classification (one referable to columns, 
the other to rows) into a 2-dimensional frequency grid ; but it is always possible to summarise 
the data exhibited in a correlation grid by recourse to the alternative device of a score-grid with 
one explicit criterion (A, not-A) of classification indicated at the margin of the columns or rows. 
Such a score-grid of two arrays is indeed the lay-out for computation of the product-moment 
index as in Chapter 8 (pp. 354-355). We may in fact summarise the distribution of sixteen 
paired (xa, хь) scores in three ways as in the numerical example below : 


(i) Frequency Grid 


(xa) 
Border-scores 0 1 2 3 
0 
1 
(x») 
2 
3 
(ii) Bivariate Score Distribution 

Xa- Xo = ‚00 0.1 1.0 11 1.2 2.1 22 23 3.2 3.3 
Rel. Freq. . = | 1 1 3 2 2 3 1 1 1 


(їйї) Score-Grid of 2 rows and 16 columns (one explicit criterion) 


Subscript Notation 


Many of the problems of manifold classification are simple, or at least amenable to simple treatment 
from an algebraic viewpoint. The difficulties of the beginner arise especially from the difficulty of 
recognising the precise meaning of the symbols. That is why we shall here use a notation which is at 
first sight cumbersome and to the student unaccustomed to subscript notation a little formidable. 
Fortunately, familiarity will breed contempt for the disinclination to get used to it. In fact, it is much 
easier to apply elementary mathematics, if one makes the meaning of the symbols as explicit as possible. 
For instance, бол, boa» bop for British officers at home, abroad on service and abroad as prisoners of war 
are less confusing to work with than the x, y, z of the school books. 


432 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


11.00 ALGORITHMS OF THE SCORE-FREQUENCY GRID 


When we say that the correlation or frequency grid is the appropriate summarising lay-out 
for a bivariate population, we use population and individual respectively for an assemblage and 
its constituents whether human or otherwise, inanimate or living. The population, as in the 
model situations of Chapter 8 in Vol. I, may consist of individual human beings to each of which 
we can assign examination marks for two different subjects (A and B) or, as in the models of 
Chapter 9, a sequence of individual games each of which is specifiable in terms of the score of 
each of two players (А and B). For purposes of computation it may be convenient to use whole 
numbers as our explicit cell entries, though in fact the most suitable schema for computation 
by machine work will not take the grid form. For analysis of the numerical rules inherent in 
any such lay-out, it is more convenient to use frequencies (ууу) as defined in Chapter З, p. 101, 
being the ratio of the cell number (лу) to the grand total (N), i.e. yi; = (mis + N). We may 
then set out the grid as below: 


Border scores а а а Sar uw WIE TOTALS 
b, Yoo Ую Ую Ue Ув ee Уо 
b Yor Yn Yn er. CONSU 7а. Уз 
by Yor E Yn ass a cene ya 
b, Yos э, Ум Am Sm Енеме Уз 
TOTALS Yor у. Ye aan Je | e£. 1 


"This schema embraces more than the structure of a bivariate population as defined above. 
With appropriate interpretation of у, it describes the frequency distribution of any function of 
the scores of two samples drawn independently from the same or identical universes. Thus 
the cell-score corresponding to уу; is (a; + b;) if our concern is with the distribution of the score- 
sum and (a; — b;) if our concern is with the distribution of the raw-score difference. In any case, 
the column totals (уу. etc.) and the row totals (у. ; etc.) respectively specify the frequencies of the 
border A-scores and B-scores, in this case the two sets of sample scores; and the product rule 
of independent assortment is equivalent to the substitution in each cell of the identity 


3ea—y4 —- 5 ` К ` (90 
In апу case, for a grid of c columns and r rows labelled respectively from 0 to (с — 1) and 0 to 
(r — 1), in conformity with the convention for finite difference series, 
=» 287] 


У ув=у.6 D Jaye 0. 5 0. 008) 

=0 j-0 

(r—1) є—!) ae 
Ja—1—= *» 5 : 2 E . (ш) 

j=0 i=0 


(r=) eD =) (1) 
Ju =1= У X». . D э - (iv) 


j=0 i-0 i=0 ј=0 
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If x;; is the cell-score of the ith column and the jth row, we may denote the mean value of 
the x-score for the ith column as M,.;, for the jth row as M,., and for the whole grid as M,. 
By definition of the mean, we then have 


1 e- 1 e 


Mz. = — > уо; Ms = — x Vij- Xiz . . . 0) 
Pi: fao У.з#=0 
(е1) (e—1) (7—1) (r—1) (2—1) (r—1) | 
У ".М,л= >й > 99 -e=M = > > Ju4g— D yaa Mis (vi) 
i-o i=0 ј=0 j=0 i-o j-o 


Example 1.—From the crude data on the extreme left determine the row-means, column-means and 
grand means of x = а. 


A-scores (а) Frequencies 


0 1 2 TOTAL TOTAL 


B-scores 3 


0) 
4 


TOTAL 


‘The column means of the x-score are 
0; (0:075 + 0-10 + 0-30 + 0-10) (04 + 1-6 + 1:5 + 2:0) 
à 025 J 0:55 
= 0; 23; 10. 


‘The row means are 
(0:075 + 0-4). (0-10 + 1-6). (0:30 + 1:5) , (0-10 + 2:0) 
0:2 d 0-3 : 0-3 ү 0:2 
= 2375; 56; 6; 10-5. 


The grand mean is 
(0:075 + 0-4 + 0-10 + 1-6 + 0:30 + 1-5 + 0-10 + 2-0) = 6:075. 


* * * * * * * 
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The customary notation of double summation in (iv)-(vi) above is cumbersome; and we 

can greatly simplify such expressions by the following code: 
1 e» т 
— > у...) =Р,. 4...) Е : - : . (vii) 


ўз, y 
1 «—» 


Та а 


У.з1=0 
(e=1) 


еб 9E). 2 075 0. o 


(r1) 


Sou. BAO uos c  . 
j=0 


(=) r (a1) 6-1) E 
24) == xq) И 
(o j=0 j=0 i-o 
Thus E signifies the operation of extracting the grand mean of the cell-scores; Es., and 
Ea.» respectively signify extracting the column (P-scores variable, a-scores fixed) ог the row 
(a-scores variable, b-scores fixed) mean ; E, and E, respectively signify extracting the mean of 
the column mean or border scores and of the row mean or border scores. In this notation 
(v)-(vi) become 
Mg. ¢ = Ey. (х); Mua = Ea. ых); 


ЕМ...) = Eq. Ey. (х) = E(x) = Е,. Ea. a(x) = Е(М,.;). 
Whence we see that 


By. By case уи), Е). аи 


The reader will note that the dot in the subscript is consistent with the customary notation 
of partial correlation introduced in Chapter 9 of Vol. I, viz. the letter after the dot indicates 
which dimension we hold constant during the operation. The same convention makes it easier 
to write partial differentials with the typewriter. Thus for u = f(x, y, 2) we may write 

du 


d 
Dy. z(u) == y Dyz. a(t) = yds” 


ete. 

We shall see that the new code will make it possible to derive very briefly certain summarising 
tautologies both of the correlation grid and of the independence grid, and we shall later (Chapter 
19) use it extensively in connexion with the non-replacement problem. In some situations our 
cell-score hitherto called х,; will be a function of both the a-score and the b-score ; but it may 
be the a-score or a simple function of the a-score alone, the b-score or a simple function of the 
b-score alone. In any case, we shall adopt the fixed convention that the a-scores are the column 
border scores, and we speak accordingly of summation in the A-dimension as summation from 
column to column, i.e. within a row if we hold the b-score constant as in the operation E4. ь. 
Similarly, summation in the B-dimension is from row to row, i.e. within a column if we hold 
the a-score constant as in the operation Es. a. 

To use the code with minimum effort, the reader should familiarise himself or herself with 
certain rules some of which refer to operations involving functions of one set of border-scores 
only, some referable to functions of both. On that account, it will be convenient to label our 
scores accordingly. If we refer to the border-scores as x,, хь, we may define 
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и = x) throughout column i when / is an integer. E E а s s . (хш) 

v; = x} throughout row j when Ё is an integer. - 5 А с z : . (xiv) 
10, = any single-valued function of both х^ and x4 in the cell (i, j), when лапа kare integers 

ог zero . y : = Я 2 > 4 5 б ё б . (xv) 


For brevity we shall also use M, . ;, M,.; for row-means, Me. ;, Mw.: for column-means, 
М,, M,, Mu for grand means of u,, v;, т; and Ma, M, for the grand mean of x, and хь. Some 
of the ensuing rules apply to all the E-operations in which case we shall use E, generically. 


Rule 1. Redundant Operations 
Since u; is constant throughout the column and v; throughout the row 
Ey. (us) = ui; Ea. (vs) = v; 
wo. E(u,) = E,. Ey. (и) = Еди); E(v;) = Е,.Е..4(0) = Е40з) . . (xvi) 
Notice, however, that 
E,4(vj) = M,., and E,(M,.;)=M,; E,.(u) = M,., and ЕМ,.;) = M, (xvii) 


Rule 2. Change of Origin and Scale 
From elementary arithmetical considerations we know that the effect of a scalar constant is 
multiplicative and that of an additive constant is additive in the process of extracting the mean 
value of a score function, i.e. 
E(K.u;4- C) = K. Esun) + С с . В ‚ (xviii) 
Since u; is a constant in ће B-dimension and v; in ће A-dimension of the grid, we have 
Eļ(uw;) = E, . Ey. (ит) = Еи. Е. (0;)]; 
E(uw;) = E, . Ey. (uio) = Е[е,. Ea. (и{)]. 
We may write the above as 
Еи. My. i) = E(u; .0;) = Ev; Mu. 5) . , - (xix) 
Example 2.—Put y, = (Зх, + 1) and 2, = (2x, + 5) in the foregoing numerical illustration 
(Ex. 11.01) so that the column border-scores become 1, 4, 7, 10 and the row border-scores 5, 7, 9, 11. 


Now find the row-means, column-means and grand mean of y3, 33. Compute also the corresponding 
mean values х? and a7, and check (xix) when и, = x; and v; = xp. 


Rule З. Sum or Difference of Means 
It follows from the last two rules that 
Ey. (u, 3: ©) = и, + Ey. (0) = и, + My. 45 
Ey. (tes + ©) = Eq. olti) v; = M,., v5 
wo E(u; + vj) = E, . By. altt; + vj) = Еи) + E(M,. i), 
2. E(u; +v) = E(u;) + E(vj) t А à > 5 TO xx) 
If зү, = (и, + vj), or di; = (u; — vj) we may write this as 
M, = M, + M,; M, = M, — М,. 
In connexion with moments, it is important to recall the rule in this form since 
$4,—M,—(u—M)-t(v—M) . -. . a (xi) 
d;;— Ma = (u; — Mu) — (v;— М) . 5 B . (xxii) 
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Example 3.—Test this rule by making a sum and difference table from the data of Example 1 
for 013 = (и, + vj) when u; = x3 and v; = a; as below: 


Sum (Xi + эй) Frequencies (x 40) Differences (х2 — x?) 
1 2 9 1 3 | 4 =ч ° 7 
" 5 12 2 2 | 8 ES er 7 4 
9 10 17 3 4 | 5 Emm 
16 17 24 2 1 | 5 = 16" [к= 


Rule 4. Partition of Variance 


One of the most important summarising tautologies of the grid concerns the partition of variance 
w.r.t. either set of border-scores x, and х, We shall write for the total variance 


Va = E(s, — M, = E(X) — M? and V,— E(x) — Му? = Ей) — МЕ . (xxiii) 
For the variance within the row or within the column we have 
Vo.» = Ea. (x, — Ma. o)? = Ea (2) — Mi.» 
and 
V,.4 = Ey. (хь — Mo. a)? = Ey. „(х) — Mic 
The mean values of the above are 
M(V,.)) = Е(ха) — ЕМ) and M(V,.,) = E(x) — ЕМ) + (xxiv) 
For the variance of the row- and column-means we have 
V(M,.») = EM.» — Ma)? = ЕМ: )— M; 


and 
V(M,.,)—E(M,,— M) -—E(Mi)—Mi . . . (ху) 
By combining (xxiii)-(xxv) we have 
V,— MV...) + VM...) and V,— MUn.) + VM.) . _. (хх) 


The reader should note that this is a necessary numerical property of any set of numbers 
laid out as a score-frequency grid ; and should test it by recourse to the data of Example 1. 


Rule 5, Moments of a Discrete Distribution 


With the aid of Rules 1-3 we may compress into a single expression several important properties 
of moments. As defined in Chapter 6 of Vol. I, the pth zero moment (и„) of a score distribution 
is the mean value of the pth power of the scores and the pth mean moment (mp) is the mean value 
of the pth power of the score deviations from their mean value. For the column border-scores 
(xq) we thus write 
ар» = Е(ха) and m, = E(x, — Mz)? = E(xa — apa)”. 

The properties we shall now exhibit are derivable from the mean value of a single expression 
involving both sets of border-scores. On the assumption that p is an integer, we define it as 


[x,— C) + (x — KIP = Е=[(х +х)—(С+К)? .  . (xxvii) 
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We may expand this by the binomial theorem in two ways as 


=p z=p 


> (= Туро — Су(х,— K) = F = > ‹ Ірка + 2) (C +K) (xxviii) 


We may therefore write 


Са CM — K)7] E) 27 C- Trpo, 4 С EKP] (оч) 


2-0 
Let us now put x» = 0 = C and К = ду in (xxvii), the ambiguous sign being positive, so that 
E(F) = Е(х, — ap)” = omy. 


We then have the rule for expanding the mean moment in terms of zero moments, viz. by re- 
course to the right hand expression in (xxix) : 


= з= 
ъ= АНЕ. = (— Wo a EG, 


2-0 z=0 
2=р 


э. Mg = EC Dhu . ал .арә-а -© t E 5 5 2 . (ххх) 
For example (the left hand subscript being redundant), 


m, = pa — Ap, ~ pa + биї. нз — Sut. 


If we put x, = 0 as before, but C = „ш, = — К in (xxvii), again interpreting the ambiguous 
sign as positive on the left of (xxix) : 


E(F) = E(x2) = att» 


z= z=p 
cats = рый, — au а = È Patt Elea — qu 
z=p А 
S арр = > Роч "sm. " Б А " * * 4 . (xxxi) 
For example, since m, = 0 and m, = 1 for any distribution 


pa = m, + Ару. m + Gp . ma + på. 

Let us now put C= aqu and К = уш retaining x, in (xxvii). From (xxi)-(xxii) above, if 
X, = (x, + хь) is the score-sum and x, = (x, — ху) is the raw score difference, we have 

w= att =C+K and  E(F) = E(s, — qu)? = т,, 

аа = s — wu =C—K and E(F)= Е(ха — qu)? = amy. 
With appropriate interpretation of the ambiguous sign (positive for the sum, negative for the 
difference) the left of (xxix) gives us the mean moments of the score-sum and raw-score difference 
distributions as 


тт, S bue. qa em — at. о . s al 


ат, "2 р(х, — щыу(х— un) ^ (xsi) 
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We shall later see how to interpret these expressions if the two sets of border-scores are 
independent. Meanwhile, we can obtain at once the familiar variance formulae 


sma = E(x, — Ma)? + 2E(v, — М.)(хь — My) + E(x, — My; 
ата = E(x — Ma)? — 2E(x, — М.х — Mr) + E(x» — My. 


The mean value of the product of the border-sco:e distributions is, of course, the covariance of 
the distribution. Thus the above are equivalent to what we have hitherto written as 


V(x, + хь) = Va + Vy +2 Cov(x,, xp). 
Independence implies that Cov(x,, хь) = 0, in which case 
V(x, + x) = Va + Vo. 


Expressions for the zero moments of the score-sum and raw-score difference distributions 
are obtainable from the left hand side of (xxix) if we put C = 0 = K, so that 


Е(Е) = E(x, + хь)? = qu, OF ans. 
With appropriate use of the ambiguous sign we then have 


so = һәй а) Lo c 4 OIM 
„= TCV)... (ow) 


Example 4.—Test (xxx) and (xxxi) by recourse to the data of Example 1. 


Rule 6. Score Products 


Let us now examine the implications of the following identity : 


E(x — apn) x — мы) = E(x) - 35) — aptnE (5) — ws Eh) + apa сора 


©. Е(ха — арп) — ыш) = E(x5-35) — ata -ohe + + + (xxxvi) 
A particular case is the now familiar covariance formula. When л = 1 = k: 
E(x, — M,)(%, — М) = Cov (xq, xy) = E(x,.x,)) — MaMy . . (xxxvii) 


The more general expression defined by (xxxvi) will be of interest in defining criteria of indepen- 
dence. We may speak of the expression on the left as a covariance of order (h, k) and the first 
term on the right as a zero co-moment of order (h, k), and by analogy with the notation of moments * 
write this result briefly as 


Cov (x), xf) = pax — pa -pr = : E (xxxviii) 


ж It is arguable that the expression covariance of order (h, k) is more fittingly applicable to the mean co-moment : 
E(x, xt) = Ех, — ani (Xy — һа)". 


However, we may interpret the alternative expression on the left of (xxxvi) as an ordinary covariance by the 
substitutions 
u-—xau()-—. and о = аб; (р) = om 
We then have 
Cov (u, v) = Efu — ni(u)][v — nio) 


= Ех — ар) — ым). 
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Example 5.—Test (xxxvi) for h = 3 and k = 2 from the data of Example 1. 
The following identity will sometimes prove useful. If X, = (x, — Ma) and X, = (x, — My): 
хь. Xa = х„. хь — М„.хь and х,. X, = x,. xy — My. Xas 
«e Е(х,у. Xa) = E(x,. х) — M, . E(x») and E(x, . Xp) = E(x, х,) — My. E(x), 
ws E(x, X) = Е(х,. х) — M, . M, = E(x,. Xp), 
7. E(x, .Xq) = Cov (xq, x) = E(x,. X) . . z 5 : : . (xxxix) 
We may likewise express the covariance in the following way 
E(x, — М.х — М) = Eq. Ey... Х(х, — My) = Е,. X [Es. (х, — М,)], 
2. Ех„ — М(х — My) = E,. X (My. — My). 
Similarly, 
E(x, — М.х — Mj) = E,. Ea . v . Хх, — Ma) = Ey. ХЕ, . (х, — М„)], 
w+ E(%q — М.) — My) = Ey. X(M,.» — Ma). 
Whence we have 
Ex, — My(M,., — Ma) = Соо (x, хь) = Ех, — M;(M,.. — Mr) . (xl) 


11.03 THE INDEPENDENCE GRID 


"To say that two distributions such as those of the border-scores xa, хь of our grid in 11.02 are 
independent in the statistical sense of the term is to say that the cell frequencies are in accord with 
the principle of equipartition of opportunity for association, i.e. with the product rule specified 
by (i) of 11.02, viz. : 
Jue. 
If we now go back to our code, we see that (vii) and (viii) of 11.02 then mean 
(=) 


ж. m m y... )mE(.. 


(e—1) 


Е) Soon: Ja Ete) 


i=0 
Tf, as before, и, = x} and v; = x4, this means 
M,.;=M,=E,(v;) and M,.,— M, = E,(u,). 
In the notation of moments, we write this as 
salt = Ey. (х) = виь and а.ы = Eq. (24) = apa i . » (i) 

In the same way, we interpret (xix) in 11.02 as follows : 

Еди. M, . 1) = E(u; vj) = Ev. My.s), 

«e M,.E,(u;) = E(u; .v;) = M, . Ev), 

2. E(u;.v;) = M,. My 

In the same notation of (xxxviii) this is equivalent to 


Prk = HA + ре . . * * * - (ii) 
Whence independence implies in virtue of (xxxvi) : 
Cov (x, 35) = Е(ха — (o — on) — 0... . — . Qi) 


When А = 1 = k we write this as Cov (xa, x;) = 0. 
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Since mean moments are expressible in terms of zero moments by (xxx) of 11.02, it scarcely 

needs formal proof that independence also implies the following relation analogous to (i) : 
ь.ать = Ey. (хь — My)* = уть and „ьт = Ea. (xa — Ma) = qm. 
Thus we may define the two following criteria of independence : 

(i) with respect to moments of any order those of the B-score distributions within each 
column are the same and those of the A-score distribution within each row are the 
same ; 

(ii) the covariance of any order (Л, k) as defined by (iii) above is zero. 

The reader should distinguish between a covariance of order (Л, k) as defined by (iii) and 
the mean value of the product E(x, — M,)*(x, — M,)* which is, of course, equivalent when 
h=1=Rk. We shall need to interpret this by recourse to a more general property of indepen- 
dence than is implicit in (ii). We suppose that F, is any single-valued function of x, alone and 
F, any single-valued function of x; alone, so that F, is constant in the domain of the operation 


E,,,(. . .) and F, is constant in that of the operation E,.,(. . .). We may thus write for the 
mean value of the product : 


E(F, . Fy) = E,[F, . E. (Fy)]. 
In virtue of independence E,.,(F,) = E,(F;) = E(F;) which is a constant of the B-score 
distribution, so that 
Е(Е,. Е.) = Е(ЕЈЕ(Е,) = Е(Р.)Е(Е) . + . . (ә 
If F, = (x, — М,) and F, = (x, — M;)*, independence therefore implies that 
E(x, — М.х — М)“ = amn my . . (v) 
A useful extension of moment notation arises in this connexion. It is consistent with our usage 
to put 
E(x) ™ = opr and E(x,— Mjy* = amn . . . «| (s) 
Whence independence implies 
MAC (х. — ae] 
53) = afn spre and [Ea = Mp LH. 


In more general terms, we may write as a consequence of independence 


nO 2000s бю 


We are now in a position to interpret (xxxii)-(xxxv) in 11.02 when the two score distributions 
are independent. For the sum distribution of the score-sum x, = (x, + x»), we then write (xxxii) 
and (xxxiv) in the form 

Бәр. 


gm, = У, ра aM: Mp- : : Н .  . (viii) 
z=0 
z=p \ 
slt» = > Pia als ohp- . А " 5 . x} 
2=0 


Similarly for the distribution of the raw-score difference x; = (x, — x), we derive from (xxxiii) 
and (xxxv) : 
z=p 


ат = = 1)*P(2) ат bmp- - 3 B 5 «y 
Pee oe ee 


z=0 
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For example, we have 
sHs = ора + Sapte. opa + aps ыз + оца 5 
apa = ара — Зара йл + Salta opta — ы 
If we recall that m, = 0 for any distribution, we may likewise write 
sMs = qms + ym, and ата = ms — уп 
We shall use the foregoing results extensively in Chapter 14. 


* * * * * * * 


Before proceeding, the student may with profit perform the following exercises by recourse 
to the data of the following table in which the cell entries are whole numbers : 


Border-scores 0 1 2 3 
2 6 | 2 8 4 
4 15 | 5 20 10 
6 9 | 3 12 | 6 


(i) Satisfy yourself that the cell entries obey the product rule. 
(ii) Find the third zero and fourth mean moments of the A-scores in each of the rows and 
the variance and fifth zero moment of the B-scores in each of the columns. 
(ii) Verify equation (iii) above for h = 1 = k, and for h = 3, k = 5. 
(iv) Make tables of the score-sum and the raw-score difference distributions and verify 
(viti)-(xi) for p = 4. 


* * * * * * * 


As a particular case of (i), we have in (xxv) of 11-02 
Му..= My—,4 and M,.,— М, = ац. 
Thus we have 


V(M,.,) = E(M,., — М)? = 0 = E(M,.,— M)! = VM.) . . (xii) 
We now recall the definition of the correlation ratios defined in Chapter 9 of Vol. I, viz. : 
2, a d т, = "брые, 


Thus the correlation ratios of a bivariate distribution аге both zero if the component distributions 
are statistically independent. The product-moment correlation coefficient is necessarily so by 
definition, since Cov (x,, х) = 0. While this is however a necessary consequence of indepen- 
dence, it is important to appreciate that it is not a sufficient criterion of independence. That 
is to say, a joint distribution may have zero covariance when the product rule does not apply. 
In 11.08 we shall look at a few model situations which illustrate this possibility. 


1.04 TAUTOLOGIES oF CORRELATION 


We are now in a position to set out certain summarising tautologies which we shall make use of 
in Chapters 12 and 20. We say that there is perfect correlation between two sets of scores if 
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there is a one to one correspondence between them. Each row and each column of the score- 
frequency grid must then contain only one entry. In our symbolism this implies that 
V, = 0 = Р. 
^ M(V,.;) =0 = M(V,..). 
Whence by (xxiv)-(xxv) of 11.02 
Va = V(M,.)) and V,-—V(M,..). 
We have already defined two grid parameters in terms of the above known as the correlation 


ratios, via. : 
ИМ.) „ ИМ.) 


Nab V, loa V, 
In accordance with our definition, perfect correlation therefore implies the identities 
Та = &1=зт„ - . А ~ - . i) 
If there is independence, as shown in (xii) of 11.3 
Tas = 0 = Tha. 


As a summarising index та» has therefore the same essential properties as ль. 

If the two sets of border-scores are not independent, it may happen that the column-means 
(mean values of the B-score associated with fixed values of the A-score) or that the row-means 
(mean values of the A-score associated with single values of the B-score) constitute an arithmetic 
series increasing (or decreasing) by equal increments corresponding to equal increments of the 
appropriate border-score. We then say that there is linear regression of the B- on the A-score 
(column-means in arithmetic progression) or of the Æ- on the B-score (row-means іп A.P.). If 
ky, and kay are scalar constants, called linear regression coefficients and Kpa, K, constants refer- 
able to the origin we then have 


М.а = Р.а: + Ky, and Ma.» = К. b; + Kay 
^ My = E(M,.,) = №. Еа) + Ky, = EM, + Koay 
> М. — My = krala; М) 


We shall henceforth write this equation definitive of linear regression of the B- on the A-score 
in the form i 
My. a — Ms = (ха — Ma) . 5 а ` - (i) 


In the same way, we shall write the equation definitive of linear regression of the A-score on the 
B-score as 
Ma.» — M, = kalts — М) . . D + - (ii) 
If there is linear regression of the B- on the A-score, we derive from (ii) in our new notation : 
Xa. My.a= Ва. — ьа. Ma. Xa + My. Xos 
ws E(xa . My. a) = Вы. E(x2) — К... My. Е(х„) + My. E(x0) 
= Е. Va + M,.M.. 
Whence by (xix) of 11.02 : 
Cov (xs, ху) = Roa» Vs. А : i 7 . (iv) 
Likewise, linear regression of the A- on the B-score signifies that 
Cov (Xa; xy) = Ray» Vy 5 - 3 : . (9) 


THE ALGORITHMS OF SUMMARISATION 443 
We now recall the definition of the product-moment coefficient (Chapter 9 in Vol. I), viz. : 
Cov (Xa, хь) 
MISSE. 
"Thus linear regression of the B-score on the A-score implies the relationship 
V. 
У, 


Ta) = 


ra ie A E S tan, S 


сь m 
d EU 5 . . . . . 
ani kra = ra i (vii) 


Similarly, linear regression of the A-score on the B-score implies the relationship 


Ta = ЕУ АА E TE n) 
(ix) 


As а criterion of linear regression in one or other dimension of the grid, it is customary to test the 
correspondence of the product-moment formula of ra, with the so-called correlation ratios 
which we have seen to have the same essential summarising properties as fa, itself. We shall 
now see that regression is necessarily linear in the appropriate dimension when 


e o co ye е . . . @ 
If there is linear regression of the B-score on the A-score we may write in virtue of (ii) above : 
MÈ . a = [Roa(%a — Ma) + МЈ 
= kalfa — Ma)? + 2. ky, - Мұх, — Ma) + Mj, 
^ Мў.„— Mi = (ха — Ma)? 4-2. Roa» Мұха) — 2. hoa» MaMy, 
7. E(Mj.,) — Mj = kia E(x, — Ma)? + 2. y, . M, E(x;) — 2. Roa» М.М, 
ws V(My. a) = ы. Va 2. Roa» МЫМ, — 2. kya . ММ, 

ИМ.) _ 
ERU 
Hence from (vi) above : 


"lla 


(xi) 


M. yl 


Tes TE > 5 7 2 Е З . (xii) 
In the same way, we derive the necessary condition of linear regression w.r.t. the A- on the B- 
score, ie. 


« VE: zt op 
Tab = ps Joey 


We may derive (xii) alternatively by a method which is adaptable to show that this condition is 
sufficient (p. 528) as well as necessary for linear regression. For brevity we shall write Cov (Xa, хь) 
as Ca» By (ii) and (iv) above, linear regression of the B- on the A-score signifies that 


. (xiii) 


(M... — М) = P. — М), 


—(M,.—M)-— Tes, = М.) =0. 
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We shall now write for the expression on the left 


Ca, 
y e. — Ма). 


a 


D = (Ms.a — Mi) — 


Thus linear regression of the B- on the A-score signifies that D = 0, as must be true if both 
its mean value and its variance (Vz) are each zero. That the mean value of D is zero is evident, 
since 


E(M,., — М) = E(M,..) — M, = M, — М, 
and since С,» and V, are constants and E, (x, — M,) = 0, the second term of the expression 
vanishes. 
V, = E,(D*) — [E(D)]* = E,(D*) 
2C,(M,., — М(х, — Ma) 
Ve 


Е 
EM, — Муу — EE M,., — Mo, — м) + DE (n, — Moy. 


zdan, a — Му)? + 


sig 


Xa му} 


In the above E,(x, — Ma)? = Va, ЕМ. — My)? = V(M,.,); and we may write as for (xl) 
in 11.02: 
E(M,., — Мх, — Ma) = Ej(x, . Ms. a) — М„. E(M,.,) — My. Е,(х„) + M;M, 
= Е(х,.хь) — MaM, = Cov (Xa ху), 
Cc 
Иа = VM, — т. 
Va = V(M,..) V, 


When D = 0, so that V, = 0, as must be true when there is linear regression of the B- on the 
A-score : 


C» 
VMs.) = y 
SY) с 
SET KaR 
+ йв = Tab 


The sufficient, as well as the necessary condition for linear regression of the A- on the B-score 
is deducible in the same way. In virtue of (i) linear regression in either dimension implies that 
for perfect correlation 

Nao = 1 = та. 


Thus the linear regression in either dimension of the grid guarantees that 7,, should have its 
essential summarising property, namely limits of + 1. 


* * * * * * * 


In practice it will rarely, if ever, happen that regression is strictly linear ; and it will be our 
concern in Chapter 18 to examine situations in which the composition of a sample is consistent 
with the assumption that regression is linear in the parent bivariate universe, though the relation 
defined by (ii) above is not exactly true of the particular set of data. We are still free to define 
a constant k,, in terms of sample covariance and sample variances in accordance with (iv) and 
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(vi), if we replace the observed mean B-score value (M, „) for a particular A-score by a hypo- 
thetical regression score x,., related to the corresponding A-score by a truly linear relation 
analogous to (ii) above, i.e. : 

х,.а— Мь = Баха — M, - : . . + (xiv) 


‘The mean of the regression scores x, . , like the mean of the within-column B-scores is identical 
with the grand mean, since 


Е,(х,. a) — My = ky. Е(х„ — Ma) = 0, 
e^ E,(xr. 0) = My i: H : - 5 Е . (ху) 
By definition in accordance with (vi) above А, in (xiv) has the meaning defined by 
T Cov (Xa, хь) 5,9% 


[a D 

So defined x,. is not necessarily an actual value of a sample B-score distribution for any 
particular value the A-score may assume. It is merely the value М», , would have if regression 
were exactly linear; but certain necessary relations between the х,. , score values and the B-score 
distribution exist in virtue of their relation to k}, as defined above and to M,. These do not 
depend on any statistical meaning we may attach to x,., at a later stage. The reader may 
with profit take stock of them at this stage and return to what follows when we have occasion to 
make use of them in Chapter 18. 

Within the sample column, i.e. for a fixed value of A, 


kra 


Ey (xp a) = Xr. a 
EU, CRP ee a ЕЭ 
Оо аА aM ae r) _. 5 З . (xvi) 
By (xiv) we have 
E(My.a-%r.a) = ЕЕ. Xa + Мь)М,.„ 
= koa Eds, — M,)My.0 + MÈ 
= Выь. Ё(%. Mo a) — А. Ma . Mp + MÈ 


= hy, Cov (хл, хь) + Mj, 
RAM л. d= УЕМ _ 0. 0. 0. s s s (жй) 
By definition also 
E(x,.— My)? = Ky. E(X2)=13,.Vn o. 0. o 0. (xviii) 


We may now obtain expressions for mean square deviations of 

(i) B-scores from corresponding values of x,.,, і.е. Ё(хь.„ — x,.,)* ; 

(ii) Mean B-scores from same, i.e. E(M,. a — x,.,)*. 
First, however, we recall that 

E(xy.4 — My.) = M(V s a) = (1 — a) Vo . . . (xix) 

We may write the mean square deviations of the B-scores from the hypothetical regression 

scores in the form 
E(xy., — x,.,) = Е(х,.„ — My — x,.4 — М)? 
E(x,., — My)? + E(x,., — М)? — 2Е(хь.. — Мь)(х,.„ — My). 
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Whence, from (xviii) and by definition of V», 

Е(хъ.. — ®,.а)% = Vil + т) — 2Ё(хь.„ — Mis. — М) . ‚ (xx) 
In this expression 


Е(хь.. — Мь)(х,.„— My) = Е(хь...х,.а) — My. E(xy.;) — My. Е(х„.„) + MÈ 
==Ж(ж,.„.х‚.) — М}. 


Whence, from (xvii) above, 
2E(x,., — Мь)(х,.„ — My) = 275. V. 
Hence (xx) becomes 
Е(ху. — х,а)? = (1 — ть), е 7 5 . (і) 


In virtue of (xviii), we may therefore partition the total variance of the B-score distribution as 


follows 
15. Vy + (1 — 05)V, — Vs > 5 а (xxii) 


oe х,.„— My)* + Eley a — 2r : a)? = Ёх,.„— My А . (xxiii) 
We shall now write the mean square deviations of the B-score means from the regression 
scores as К 
E(M,., — x... = ЕЁ(х,.„— My. a)? = Е(х.. — М. — Sva — e.a) 
= Е(х,.. — Ms . a)? + E(xy.,—x,.4)* — 2Ё(х,.„— My. o) (X».a— Xr a). 
Whence, from (xix) and (xxi), 
Е(М,.. — х. a)? = (1 — ты)» + (1 — ra) Vo — 2Е(хь.„ — М.а). — е.а). 
In the above 
E(xy..— My . X» . a — х. а) = Exp a) — E(x . a + Xp.) — (1s. a. My.) + E(My. eer) 
= Е(аб.а) — E(M;.4) = M(V, . a) 
e 2E( a — My. e.a — 2а) = U1 — 1) Vo. 
Whence we may write 
E(Ms a — Xr. a)? = (1 — Wa) Vo + (1 — та) — 2(0 — a) Vos 


^ E(My.a — %r.0)* = (1, — 15)" T : ч : З . (xxiv) 
We may now make a tripartite division of the B-score variance, since 
(1 — Ma) Vo + (tba — Ta) Va + T. Vo= Vy . г ‚ (xxv) 


E(xy.4 — М.а) + E(My.a — х. а)? + E(x, . a — My)? = Е(хь.. — My)? (xxvi) 


For later use, it will be convenient to express this portion in terms of the score-grid pattern, 
by arranging our paired scores serially in c columns corresponding to c different values of the 
A-score. If the number of individual B-score values in the ith column is r; and л is the total 
number of paired scores, 


jaen E 


yeaa У уш md s—»*rm . : n . (xxvii) 
ј=1 


= 


* If regression is exactly linear (54, — 7%) = 0 and nsa = Fas. Otherwise, pa > 7, since the expression on the 
left is necessarily positive, being the sum of square deviations from the regression score. Thus E(M,. a — Xe. s)? 
is an index of departure from linear regression. 
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On this understanding, if b;., denotes any B-score value in the ith column: 


dee jan 1 


1 
E(x,.4 — My. —- У т: У (bi. — My. 93 58S; 
nei ee n 


i=e 
Rr =1 Уу а E 
nj, n 


pfe 1 
E(x,.,— My)? = – S r(x,.,— My? = Sy». 
nizi n 
We then have 
imej=r 
1—1) = Sim = > У ridb Mo) . . (x) 
i=1 j=1 
imc 
nuh—n)V—Sa-2Xr1Ma—x . 0. + .  « (xxix) 
i=l 
i=e 
О5о = X nse—My ._._ 9 x (x) 


=i 


There still remain two important tautologies of a correlation grid for future reference. Let 
us denote by rəm the correlation coefficient between the B-score distribution and the B-score 
column means. This merely signifies that we replace the border A-scores by corresponding 
values of M, .a as written at the foot in most of the grids of Chapter 9 in Vol. I. То say that 
regression is exactly linear is to say that the substitution merely involves a change of scale and/or 
origin; but we have seen in Chapter 8 (p. 353) that change of scale and origin of either set of 
scores does not affect the value of r. Thus linear regression implies the identity 


Tom = Tar: 
This is implicit in other identities cited above. By definition 
5 Cov (My. a хь) 
эш == ЕЕЕ. 
VV(M,.,). V, 
In the above, linear regression signifies that 
Cov (M, . a) хь) = E(M,., — My))X, = kra . E(X,. Ху) 
= hy, Cov (Xas x). 
Whence, from (iv) above, 
Cov (My. as хь) = Kin nas 
Also from (xi) above, when regression is linear, 
VVM, Va = NK. Р. = тать. 
‘Thus we have 
Tom Rito |. ш 0. ж (xxxi) 
9, 


'The reader will later find that this result is important in connexion with the definition of 
the multiple regression coefficient (Chapter 18). 
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EXERCISE 11.04 


The student may check numerically any of the relations of this section by recourse to the models cited 
as Examples and Exercises in Chapter 9 of Vol. I or by reference to the Model of Fig. 90. 

The reader will also find ample opportunities for testing the tautologies involving relations between 
B-scores, mean B-scores for a fixed A-score, and hypothetical regression scores at the end of this section 
by interchanging members of any number of consecutive pairs of columns in the Model of Fig. 93. This 
will have the effect of displacing individual mean column values from what we shall later define as the 
line of best fit through the whole assemblage of mean column scores. 


11.05 TAuTOLOGIES OF THE SCORE-GRID 


In Chapter 10 of Vol. I we have explored what assumptions we make about the structure of a 
universe, when we attempt to make a balance sheet with respect to sources of variation from the 
information a sample supplies ; but we did not attempt to specify how we estimate the compon- 
ents of variation from sample data from the universe of our Handicap Score-grid Model. When 
we later seek a rationale for the statistical procedures commonly subsumed by the expression 
analysis of variance, it will be helpful to be clear about what characteristics of a score-grid are 
tautologies of any such lay-out of numbers, regardless of considerations relevant to statistical 
principles or of what conclusions are our preoccupation when concerned with sources of 
variation. 

The notation employed in the preceding sections refers only to the type of grid which exhibits 
cell frequencies referable to cell-scores themselves functionally related to either or both of two 
sets of border-scores. When discussing the type elsewhere spoken of as a score-grid, it is neces- 
sary to modify our symbolism. In such a 2-dimensional lay-out (p. 429) of c columns and r rows, 
each cell entry is a single score with gross frequency (cr)-". Its frequency within a column is 
r-1, and within a row c~. If x;; is the cell-score of column 7 and row j, we may define below 


TABLE 1 
Mean Variance 
15327 тоет 

Whole grid . 0. 0. M=- У xu Q2 У б-м 
TU j=l тегү jet 
1e qose 

Within-row (jth) scores — . , M,- 2E ғи DG DU 
i=l =1 
jer ie 

Within-column (ith) scores... м.=- У хи 22, u- My = V, 
j=1 j=1 
iz dm 

Row means . 0. 0. € м => У м, 5 > (My — MP = ИМ) 
j=1 j=1 
14 e ае 

Column means . . . . M=; У м IÈ 04 - My = (М) 
$21 i=1 
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TABLE 2 
Mean Variance 
Whole grid . ж. n E,. Efx,.) = М E,.Eí(x, — MP = V = E,. Ed.) — М? 
Within-row scores " Я Ех) = M, Ех. — Mj? = V, = E(x) — M} 
Within-column scores . . Ех.) = М, Ех, — М.) = V, = Ед.) — М? 
Row means ` E . E{M,) = М EM, — My = V(M,) = E,(M}) — М? 
Column means . . . EM) = М EM, — My = V(M,) = E(M?) — M* 


certain summarising indices of the grid as in Table 1. Three operative symbols suffice to ex- 
press these relations compactly, viz. : 


Lizz ize E Hn =ej=r 
= 2, Se DN wA P3 ) 
i-r i-e 
i$.) and S TEE 
j=1 сї 
7. Ep. Ed. . .) = Ё(.. к= Е.Е...) И a d m 


Under the sign of the preceding operators, we may label x; indifferently as Xer or х,. with- 
out confusion, and parameters accordingly as in Table 2. It is important to recognise that the 
operation E, signifies extracting the mean value of cell-scores or functions thereof from row to 
row. Hence E,(x,,) signifies taking the mean of the r cell-scores within a column. Similarly, 
E, signifies extracting the mean value of cell-scores or functions thereof from column to column. 
Thus E,(42) signifies taking the mean of the c square scores within a row. Table 2 shows the 
same entries as Table 1 in the new notation. Without ambiguity we may write 


E(V,)=M(V,) and ЕДУ.) = M(V.). 


If u,, is any cell-score function (e.g. 32) P, and Р, being row parameters and column para- 
meters respectively, the following rule holds good for constants definitive of scale and origin : 


E(A.u, +k) = А.Еи.) +k and EA. ty, +k) = А.Еди,.) + Е; 
E(A.P,--À) = A. E(P,) +k and E(A.P,+h)=A.E(P,) +k. 


Since M, and V, are constants w.r.t. rows within a column as are M, and V, w.r.t. columns 
within a row, 
E(M)- M, апі ЕДУ) = Ү,; 


E(M,)— M, and ЕДУ,) = V, 
The following identities implicit in our definitions will be useful in what follows : 
E(M..x)— E.[M..E,((x,] = E(M?) . : n о 209) 
Е(М,.х) = ЕДМ,.Е4х„)] = ЕДМ?) . д кр: . (ш) 
E(M . x) = M . E(x,.) = М? . 5 : 3 s . (iv) 
E(M,. M.) = E[M,. E(M)] = E(M,.M) = М . 5 E42] 
EKM.M)—-M:—E(M.M). . . . . . . (wi) 
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In this notation the fundamental tautology of the grid takes the following form : 
V = E(xj) — M*; 
V(M,) = ЕМ?) — M*; 
V, = Exi) — Mr; 
M(V,) = E, . Exi) — EM?) = E(x) — ЕМ), 
^. M(V,) + V(M,) = Е(х) — М? = V. 
Similarly we derive 
MV.) + VM) = V. 
Whence we have 
M(V)-VWM)-V—M(V)TV(M) . . . . (wii) 
In the Analysis of Variance we shall have recourse to a grid parameter which we can define 
alternatively in virtue of (vii) as 


V—V(M)—V(M)—V.—M(V)-M(V)—V . . .(уш) 
Whence it follows that we can also define it in terms of square deviations of scores and means by 
тс. У, = У —rV(M) —re.V(M) . . « « (x) 


For purposes of computation it is useful to set out a score-grid in duplicate for scores and square 
scores as in the numerical example below. All the requisite data are then in the marginal totals 
and their squares. For the grand total of square scores, we shall write S,, so that 
imejar 
=> Se: e — C NN 
ij 
The following code defines other requisite quantities : 


Score Totals Sums of Squares 
i-e j=r 
Row T, = > xy=c.M, s,=1> Д А я - (x) 
i=l j=1 
= ЕЕ 
Column T= su -r.M S=-> Тг. B А . (xii) 
ј=1 i=l 
к ; 
Whole Grid Tex атте М Sm E š s . (xiii) 
#=13=1 
Ву definition 
vM) - IS м— м => т 1 
(M) DO sts 2, | re * 
„му а ees. 
TC TC 
Similarly, we derive 
им) =1s,—1s. 
re TC 
Likewise by definition 
Va Tn D. 


TC TC y 


#7 


Реф”. 
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Whence from (viii) 


We may write these results in the form : 


r.V=S,—S. i ` s; T > ‚ (xiva) 
re. V(M,)=S,—S . . . 5 . - ‚ (xivb) 
re. V(M.)=S.—S . : E 2 5 . (xive) 
r.V,=S,+S—S,—S,. : ; 5 (xivd) 


The last expression is obtainable directly from the foregoing by recourse to (ix). In the follow- 
ing example r = 2 and c = 3: 


T Square Scores. 
36 1 | 16 

144 9 | 25 

180 


Total 
тр 


From the foregoing code 
S—1(8)—54; S, = 68; 
S, = (180) = 60; S, = 1(122) = 61. 


Whence we have 
у= 1(68— 54) ={ 


V(M,) = $(60 — 54) = 1 
VM) = 4(61 — 54) = 4 
V.=$-1-$=3 
As a check we can of course lay-out the computation from first principles but with less economy of effort, 
as below 


Xu E M, (x, — М) M, (x, — M) 
1 1 2 1 20 1 
4 16 2 4 45 1 
1 1 2 1 255 H 
3 9 4 1 20 1 
5 25 4 1 45 i 
4 16 4 0 25 H 
"Total 18 68 18 8 18 7 
Mean| з m 3 n 3 i 
M [ V+ м? м M(V,) = V — V(M,) M MV.) = V — V(M) 


y—-5-9—-i;VM)-í-i-i;VM)-i-i-i 
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OPERATIONS IN A 3-DIMENSIONAL SCORE- GRID 


E00" Mam” is, E, 00 * My on™ DEM EJ £,00* M, хы 
uu ua E E Man исм, о?и а, ES cox n E 


tt oM EET = 
EEO Mu ue EE E Oy Mg? 
tous n Ё ор £t, oM, Poe di B on Mac? 
EE Mu eun dE Ern Mui 
Fic. 85. "The 3-dimensional Score-Grid. 


The foregoing relations refer to a 2-dimensional grid admitting 2 criteria of classifying the 
constituent scores. Let us now accommodate 3 class specifications in a grid (Fig. 85) we can 
visualise by addition of a vertical dimension of layers we label as л = 1, 2, 3 . . . п. We shall 
denote our scores as x,,,accordingly. "The total number of cells in the grid is then nrc distributed 
as follows : 

Layers — rccells — Row-Slabs nc cells — Column-Slabs тт cells 


Pillars n cells Rows c cells Columns r cells 
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With this end in view we may retain the symbols E, and E, as within-layer operations in exactly 
the same sense as before, adding the symbol E, with the following meaning : 
1 л=п 


Е, (.)= 50.9). me ccn ne SE 


Accordingly we define E anew as the operation w.r.t. all cells of the grid as 
E,.E,.E,=E,.E,.£, etc, 
in any order. To distinguish parameters of the whole grid, parameters of two dimensions 
(layer, row-slab, column-slab) and parameters of one dimension (pillar, row, slab) we may employ 
a convention already used in connexion with partial correlation (Chapter 9, Vol. 1). Ву Р, 
we signify a parameter of the whole grid (e.g. the total variance V;). Ву addition of n, r or c 
respectively after a dot we signify that the parameter refers to one of n layers, one of  row-slabs 
or one of c column-slabs. By addition of rc, nr or nc respectively we identify it accordingly with 
one of rc pillars, one of nr rows or one of nc columns. Table 3 gives the code, to which it is 
only necessary to add 
E,. E,(V z. re) = М(У,.„); EV s. е) = M(V,); E(V...) = M(Va. o). 

Corresponding to the two identities of the 2-dimensional grid specified by (vii) we may now 
formulate 12 w.r.t. the solid score-grid. Since each layer, row-slab or column-slab is itself a 
2-dimensional grid, the following six call for no comment, being implicit in (vii) : 
Within layers : 

EV n.on) + E (Mu. on — Mz.n)* = Va. n = EV u. en) + E(Mz rn —Me.n)®  « (xvi) 
Within row-slabs : 

E(Vz. en) + Е(М,. en — Ma. e)? = У... = ELV o. r0) + E Ma. ro — Ma.) . (xvii) 
Within column-slabs : 

En(V a. on) + E (Mz. en — Ma. e)? = V a.e = ЕДУ.) + E (Mu re — Mao)? (хуй) 

Other results follow from the possibility of rearranging the grid cells. We may put the 
nc cells of each row-slab end to end to make а 2-dimensional grid whose total variance is V',. 
This grid has still > rows of лс cells and nc columns of r cells, the row variance being V, , and 
row mean M,.,. Accordingly, we have the row-slab identity : 

ЕДМ... Ma) + ЕДУ...) = V. 

If we put the zr cells of a column in single file we can make a grid of c columns, with column 


variance V.. , the mean being M,.,. Again the total variance is V,, whence the column-slab 
identity : 


E(M,., — Mz)? + ЕДУ...) = V. 
If we lay out the rc cells of a layer as a single row, we may make a grid of n rows with row variance 
Vz. ny etc., whence the layer identity : 

E (Ma. n — Mz)? + EnV i. n) = V. 
Finally, we may derive the following relation between pillars : 

E, . E(M,. re — М.) = E, . Е(М: „) — 2Mz. E, . (Maz. re) + M; 
=E,. E(M? ,.) — Mi; 
E,. EKV 2. re) = Е,. Ee + E (i) — E, . ЕДМ? „), 
^. Е,. E(Mz.re— M3} + E,. EV a.r) = Её.) — М? = V, 
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Similarly we may derive and write without ambiguity, the two following identities : 


V(Mz.en) + MV a. on) = Ve = V(Me. rn) + MU, rn) 


Ca — Parit = cor арр n git = ttp rtp) 
iW — (Ea I IA (rug ig я = И PHB әјоҷм 
{и — Cung = QU Lt neg = (pig = N a =) 
CWA = CW —° "NYT "мал UIN — Ola я Cya I= a qes иштоо 
iw — {ИЯ = Cw — irt Qr = 8 yy =) 
CWA = CW —* "nya +A = чи -C Ra я eor = N qvis Moy 
w- (ТАЯ = Cwt eya я = eweg =" ty 4g =) 
CUDA = CW — "Wy “4 = in (руя я (Maya к =" 74 mv] 
ФИГ — (“EN "a = CW — xT = Е 
("DA = CW "IRR "A aa и bye Quy m ttp Wo 
ew бия "a = qt — 48 Oxy = 
(m = CR - I tRYG Ig Aaa чиг beg (org mmt hog 
tw Casu = t Ly А 
("Wa = CW — "ae way Sey — (P aya Qut = p 
зизәрү jo aouvreA. из 591008 эо JO әошизд. suvoj 
C — —M. 


Е 3'ISV.L 


We may write the identities last derived without ambiguity as 


(xix) 
(xx) 
(=a) 


ERE 
а 

DU 
mus 
+++ 
ERE 
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ҮМ...) + M(V z. r) = V. 
V(Mz. nc) + М(У,. nc) = Vz 
V(M,. nr) + M(Ve.nr) = Ve 


In the Analysis of Variance for 3 criteria of classification, the sample parameters which we 
shall use are Va, V(M..,), V(M,.), ViMz.n)s M(V a. re), M(V z. ne) M(Ve.nr) and three 


others defined respectively as follows : 


V(Mz. ro) — V(M,.;) — И(М„.) = Vin 


= M(V,.;) + М(У,..) —M(Ve. t) — Va 


V(M,.5.) — V(M,.4) — V(M,..) = Ver 


= М(У,. Ӯ) + MV,.) — MV s. no) — V. 


V(Me. nr) — ИОМ...) — V(M..;) = Vie 


= M(V z. n) + М(У,.,) 


For economy of computation we may employ the following schema in which 


Aenimejor 


5 = > > > xy 


The other items of the code аге: 
Cell or Marginal Totals 


hen 

Ty = У хм =п.М,; 
het 
jar 

Thi = > хы =". My 
j=i 
ime 


Thy = У хы =c. М 
[Eri 


henine 

T;= У > хм =п.М, 
кезш 
hanjar 

T,— > > му = ar. M; 
h=1j=1 
бејт 

T,— У У хм = 1с. М, 
iij 


h-ni-cjor 


T-—- > У хм; = ncr. M 


A-eli-l1j-1 


‘The reader can check as an exercise that 


һ=1{=1ў=1 


Mean Sums of Squares 


ner. Va = Sa — S 
ner. У(М,.,) = 85, — S 
ner. V(M;z..) = Se — S 
ner. V(Mz. n) = 85, — S 
ner. M(V s. re)= Sa — Sre 


M(Va.nr)— Va 
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. (xxii) 
‚ (xxiii) 
‚ (xxiv) 


(xxv) 
« (xxvi) 


+ (xxvii) 


(xxviii) 


(xxix.a) 
(xxix.b) 
(xxix.c) 
(xxix.d) 
(xxix.e) 
(xxix.f) 


(xxix.g) 


(xxx.a) 
(xxx.b) 
(xxx.c) 
(xxx.d) 


(xxx.e) 
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ner. (V...) Sa — Sne 
ner. M(V z. nr)= Sa — Snr 
лет. Ум = S + Ser — 8, — 8, 
ner. Vae = S + Snr — Sa — 8, 
ner. Var = S + Sne — Sn — Se 
ner . V = 85, + 25 — S, — 5, — S, 


(ххх./) 
(x.g) 
(xxx.h) 
(xxx,j) 
(ххх) 
(xxx.) 


The following simple numerical example, in which п = r = c = 3, illustrates the pro- 


cedure : 
@ Gi) 
Scores 
m =й oie Within-cell sums of Squares Total 
2.2.2 2.4.3 | з.1.2 | 12 29 | 14 55 
2.8.1 5.1.3 3.6.3 14 35 54 103 
4.0.5 6.2.1 5.5.2 | | 41 41 54 136 
| 
5, 294 
(ii) A 

Soa Square Cell Totals (T) Total 

36 81 36 158 

36 81 144 261 

sı | 81 144 306 

Total 
Ti Total 720 


From the above entries we have 
Sq = 294; Spe = $(720) = 240 ; S = уу (78°) = 2928; 
S, = S, = 1(2070) = 230. 


Whence we obtain 
V,— jy 94 — 2928) — зда; 


M(V z. re) = 30294 — 240) = 2; 
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To compute V(M, , „) we must assume some definite order of the items in each cell of (i) corre- 
sponding to the 3rd criterion of classification, and assume that we have therein arranged them 
accordingly. We then have the following lay-out : 


(у) 
2.4.3 3:172 
5.128 3.6.3 
6.2.1 5.5.2 
Layr 1| 8 TM ie " 11 | 
Totals 2 7 12 
з | Sem 


From (v) we derive 
S, = 2904; S,— S= 5%; 


V(Mz.n) = 5: 
To derive M(Ve.nc)» M(Vz.nr) and hence V,, or V, we shall need to rearrange the items of (i) 
alternatively as below. 


(vi) (vii) 

imi in? ims ES в=2 h=3 

һ=1| 2.2.4 2.5.6 | 3.3.5 2.4.1 2.3.2 
h-2| 2.3.0 | 4.1.2 1.6.5 3.1.6 1.3.3 
в=з| 2.1.5 | 3.3.1 | 2.3.2 5.1.2 
Square Cell Totals (T1. Total. Square Cell Totals (Ту). Total. 

64 169 121 354 49 49 49 147 

25 49 144 218 100 100 49 249 

64 49 49 162 225 49 64 338 
Total | 734 Total | 73 


Whence we obtain 
Sne = $034); S, = 3(734) 5 
27. M(V sinc) = 294 — $(734) ; 27 . M(V z . nr) = 294 — $(734), 
ot MV ene) = ME; MU) = M: 
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EXERCISE 11.05 


1. Check the dual relation defined by V(M,) + M(V,) = V = V(M.) + M(V,) with respect 
to the following sets of scores first by direct computation and then by the sum of squares schema, i.e. 


S,—S=er.V; S,—S=cr.V(M,); S, — S= с. V(M,); 
cr. M(V,) = S,— S, and ‘cr. МУ) = $,— Sp 


2. For each of the above determine 
V,— V — V(M)) — V(M,) = M(V,) + M(V,) — V. 


8. By recourse to the E notation of this section show that 
E(x,, — M, — M, + М) = V,. 
Check this result by direct computation w.r.t. the foregoing numerical examples. 

Hint.—Put (к, — M, — M, + My = [к — M;) — (M, — MDP. 

4. Determine the parameters V,, V(Mz.,), V(M...), V(M..,), M(V,.,.), M(Ve.nc) and 
M(V,.,,) for the following set-up by direct computation in accordance with definition and by 
recourse to the sum of squares schema : 

S,—S=ner.V; S,—S-—nr.V(M); S, —S—nr.V(M,); S, — S = пог. V(M,) 
S, — Sep = пт. М(У„); S, — Sno = ner -M(Vne) ; S, — Snr = ner. M(V,;) 
2.2 4.1 6.3 1.1 
1.9 1954 7:51 0.2 
4.2 2.5 4.5 2.8 
5. By recourse to the E notation show that 
E(M,, — M, — M, + MP = V m 
Hint.—Remember that the parameter of any particular dimension of a grid is a constant w.r.t. an 
E operator in any other dimension, so that 
ЕДУ...) = У... = EnV z0); EdV a.r) = Va. r = ЕУ.) 5 
ЕДУ, а) = Van = ELV a.n); EVs. r) = Va. re 


6. Use the data of Example 4 to determine V,,, and V,, defined by analogy with Иш, i.e. 
V, = M(V;) + M(V,) — M(V,,) — V; 
Vi, = M(V.) + M(V,) — M(Vnc) — V. 
Show that the results are numerically consistent with the alternative definitions : 
V, = E(M,, — M, — M, + My; 
Vir = E(M,, — M, — M, + My. 
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11.06 ADDITION oF COVARIANCE 


It is possible to extend the use of the symbolism of 11.02 to more than 2 dimensions. Thus 
our concern may be with a function Fase of З score-sets Xa, Хь, Xes in which case we may write 


E, (Fav) = mean value of F,,, for all values of c when both a and b remain 
constant. 
Е,.„.Е,. (Еле) = mean value of Е, ,, for all values of b and c when a remains constant. 


Е,.Е,.,.Е,.„ХЕльс) = mean value of Fase for all values of a, b and c. 


In this symbolism the operation of extracting the grand mean is 


RISEPRISE.a(C.)eE(.)mESGEs.Ewao--) = = (i) 
By. Esis Bool - -) = Е(. .) = Es. Eo.p. Eao.) - ` (ii) 
EQQES-E.a..)m9E..)mE.ESseEew..) - . (ii) 


We may also need to combine the symbolic conventions of 11.02 and 11.05 to cover a case 
of special interest, e.g. when we have c sets of paired scores x, and хь, for each set of which we 
can assign a covariance. We may then denote: 

(i) by E;,.. the operation of extracting the mean of a function of both sets of border- 
scores in one and the same set ; 

(ii) by E, the operation of extracting the mean of any parameter (e.g. Va.e or Vy.) of a 

set. 
We should then write 
E = Е,. ЕЁ. 

In this case, the criteria of classification in the А- and B-dimensions of the 3-dimensional 
grid are quantitative, always being defined by the border-scores ; but the criterion of classification 
in the C-dimension is qualitative. For a case of special interest, we may write the covariance of 
the border-scores in a single set as 


Eav. (x — Ma. e)(%» — My.) = Cov (xa. c хь.) 
= Ё.,(х„.,. ®.) — Ma. Myo . (iv) 


Its mean value for all sets will then be 


E, . Cov (x, хь.) = М. Cov (x, хь) = E(x х) — EL Mao. Mo.) + (у) 
For the covariance of the paired values of х,, х, treated as a whole, we must write 
E(x. — M,)(x» — My) = Cov (x, хь) = Е(х„.х) — М„.М, . - (м) 


Now there are c pairs of mean values Ma . e M,., from which we may form 
ЕҲМ... — M;(M,., — My) = Cov (M, e М.) = E(M,... Мь.) - Ma. M, (vii) 
From (v)-(vii) we thus obtain a tautology of a 3-dimensional set-up reminiscent of (xxvi) in 


11.02, vis. : 
Cov (£a, хь) = Cov (M, . es My.) + M . Cov (xa, x) . г . (viii) 


We can express this in a form involving regression coefficients in virtue of (viii) and (x) in 
11.08, viz. for regression of the B-score on the A-score : 
Сою (кы ғ), р _ Cms Ms) р Coco m.) 
үре LED VM.) tot V... 
marl accus: FM) F Musas Face)! - н „^ Дш) 


kra 
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If each of the c sets of paired values x,, x, is divisible into r sub-sets, we may proceed to 
obtain expressions comparable to (viii) by recourse to the symbolic convention : 


Big Bah e К у= Bie Bi Bia de) С 


Equation (ix) holds good only if regression is linear; but (viii) is true of any set of numbers 
which we can pair off in layers of a 3-dimensional grid. Whether the layers are of equal size, 
ie. whether the number (r;) of pairs in the ith layer is the same as in any other, is immaterial, 
For purposes of computation, we may suitably lay out our figures in 2 dimensions as below. 
The reader may test the relation involved by recourse to other collections of numbers arranged 
likewise. 


Block. U V Ww 
ха. X». LI Xs. Xa. LI 
3 5 10 12 1 3 
2 2 8 9 3 6 
4 vi 5 6 2 5 
2 4 3 3 1 2 
Totals 11 18 26 30 7 16 
Means 235 45 65 75 175 40 


The total of the 12 A-scores is (11 + 26 + 7) = 44 ; and that of the B-scores is (18 + 30 + 16) = 64. 
For the grand means we have therefore 


M,=32 and M,= 48. 
The lay-out for the computation of Covariances is as follows : 


Xo. us Xo. u а. 6-р. Xa. w Xo. w Ma.u- Му. 
15 120 3 
4 72 18 
28 30 10 
8 9 2 
55 231 33 545+ 8 
13-75 57-75 8:25 545 = 24 


"The mean value of all cross products is 

55+ 231 +33 319 
12 оү, 

Whence the total Covariance is 
319 11 16 506 
RS Ug Em 

The covariance of the means is 
545 11 16 227 


2 337-5 0:500 0: c 68) 
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The covariances of the individual blocks are 


198 22 780 144 12 290 
ете є 7 16 0b 16 > 16 


The mean of the above is 
224144420 279 2 
cca pee ae md - ^ А : + (xiii) 
Hence in accordance with (viii) we have 
227 | 279 506 
Cov (Ma, My) + М. Cov (xa, хь) = 79 + 79 = 75 = Cov (хь, хь) 
For rapid calculation it is preferable to work throughout with score-sums and sums of score 
products as follows. If r; is the number of pairs in the ith layer of c blocks, we define : 


jen jean 
Sa. = È si 8,,— > хы z - E . (xiv) 
j=1 jut 
ime ime 
SEES Ses 5.4 DUE c. Pea OT) 
i=l i=l 
i=oj=r 
Sas = > P3 Kaiz Xiz . . * . : e (xvi) 
í-21j-1 
1 ime 
P,=—S,.;-S).33 "= > ri s З 3 А ‚ (xvii) 
т; i=l 
ime 
Ene sS D lle 5 : А 7 . (xviii) 
i=1 
In this symbolism : 
Sa. So A 
n Соо (ха, хь) = Say — = (xix) 
n.M. Cov (x,, хь) = Sa — Sp $ E : = = xx) 
n Cov (Ma, My) = 8, — 5.5, (xxi) 
In the foregoing example n = 12 andr, = 4 for all (3) values of i, the remaining relevant items being 
198 780 112 
Чек у fm 
S,= 58, Sap = 319; S, = 44; S, = 64. 


One consequence of (v) above, of importance in connexion with the theory of regression, 
is sufficiently elementary to merit comment in advance. Let us suppose that the same set of 
A-scores (i.e. the same values of x4. с in the same proportions) occur in each of the c sub-samples. 
We may then write Ma.. = M, for each set, whence 

E (Ma. e- My.) = M,. My. 
If the c sets of paired scores each have the same fixed set of A-values in the sense defined, it 
therefore follows that 
E, . Соо (Xa . es хь.) = E(x,.3)) — M,. My = Cov (£as х)  . . (xxii) 
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11.07 SUMMATION BY FIGURATE SERIES 


In Vol. I (Chapter 1) we have seen that it is possible to obtain expressions for certain power 
series relevant to determination of zero moments by recourse to figurate number series. To 
derive results we shall later use in determining moments of a distribution, in particular sum- 
mation of products of reduced factorials, it is also convenient to make use of the properties of the 
family of figurate numbers (s — 3 in Fig. 86) to which the unit, natural numbers, triangular 
numbers and tetrahedral numbers belong. For the foregoing we may use the symbols °F, 


Ronk tr) 
1 


iE-45 


Fic. 86. Figurate Numbers in 3 dimensions. 
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ТЕ, °F, ЗЕ, severally to denote the term of rank л and in general ^F, for that of the d-dimensional 
class generated from its predecessor of (4 — 1) dimensions in accordance with the same additive 
law, so that for positive integral values of d and n : 


Surette Sig у ух, у: @ 
т=1 r=0 


The general expression for the family is a reduced factorial, viz. : 


d — 1y? Re 

ayy = 605 oe 4— the Жр. к 
If we extend these series into the domain of negative integers the law of summation is (ix) of 
1.02, viz. : 


т=п 


DUM m HB РРР) 
r=—m 
Hence if k > 2 and n > k 
r=n—-k+1 
tF, = SEIR DET Е Di E a 
r= 20-2 
Since *+1F_, = 0 for all positive values of А 
r=n—k+1 (n + Der» Я 
Е, = вр, aai —L—A c 2 5 . (v 
on наа Di m 
Now we may write for a sum of factorial powers of the integers 
т=п т=п (0) а= ron—k+1 
SeMH=N ST =k S RH Y CB 
z=1 z-1 k! z=) ra —k+2 


Whence from (iv) when k > 2 


теп (п + et» 
a _._ 
2* =o л ume (v) 
When k = 1 or 2, this is evidently true, since 


т=п т=п (2) 
> x 2 1p, = FB, (n = ; 


т=1 т=1 

т=п т=п теп-1 (3) 
За ар, iv li 0", 
2=1 z-1 r=0 


Hence (v) is valid for all positive integral values of k < n. 
In the positive domain the following relationship is also of fundamental importance : 


Uoc cg PD) 


In virtue of these identities we may now establish the following theorems relating to the sum of 
products of reduced factorials : 


с=п 1e» 
È oln + da-n = Cat Бш ie rim POR 
T ktr ат е „= + mtr—Ny- «(vi 


z=0 
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We may write the last in the form 


ear 
У rk +e — 19 (m+ r—x— 1679 = (k +m +r — 1? 


z-0 


We can derive these from a consideration of the figurate form of the binomial expansion 
‚ ЩЕ+ D, ‚ Kk + 1)(6 + 2) a 


(1— а) — 1-4 kx 4 2 і 3l . etc. 
= Fan + Vy! + Fax? + Ер, etc. 
roo 
= > hx, 


r-0 
ime 
PELLE = Pirat 
ie 


=(1— a> (1 — ay" 
= (ФЕ? + UF xe! + Fit + Fax? . . . ete.) 

X Fx? + UF yx! + Fn? + 2F yx? ... etc.) 
= Fy. F yx? + (OFr. Fm + Fp. Fm) х 

+ (%Е,. Fm + Fe Fm + Fr Fs) 


+ (Fp. En + 1E, Fm + Fro Fa t’ Fr. Fn)? .. . ес. 


= SR. Fps, 
т=0 z=0 
RES "IIS 

blu AEST ey Ж "КОШ. 
r=0 r=0 2=0 


Hence by equating coefficients we obtain 


dur 
2 Nit tm 


z-0 


This is equivalent to (viii) and (ix) above. If we put k = n = m it becomes 


У (n+x ln +r— x l)er- = nr Dy - 


Now we may write the expression on the left of (vii) in the form 


с=п с=п 


> cun — Je- = È Fer CIF, T 


(ix) 


(x) 


(xi) 


Since c® = 0 unless c > x, we may set the lower limit of summation at c = x, and since 
(n — c)*-® = 0 unless (п — с) 2 (s — x) we may set the upper limit of summation at 


c=(n—s+2), Le. 


с=п e=(n—s+2) c=(n=2+2) 


È %—д„= >  «wn—05-5— > Peri T Fecerat 


e=0 с=т е=т 
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We now put z — (c — x) 
Per 2=(n—3) 


У ео 2° “hare "Буа. 


e=0 z=0 


In virtue of (vi) and of (x) above, the expression on the right is equivalent to 


z= (п г) 
Жыз." Fy "Еа ЗЕ, 
ET 
In the notation of reduced factorials 
a MES pes 
n—-sl (n + 1)! 
Hence in accordance with (уй) 
РЕ n+ pee» А 
PL = Ә-ә = e —(ntlen - - + (ш) 
We shall later make use of an extension of (xii) which we can derive by recourse to the identity 
_ (6+ Deas 
(e + 1). +0 = KEETA 
oe (x NE + Dosen = с. сш T Cem : . : + (xiii) 
In virtue of (xiii) we may thus write 
e=n с=п есп 
> €. C(t — e)u-a = (x + 1) > (c + Ioan — 96-2 — 2 со — e)u-» (xiv) 
e-0 e=0 e=0 


To reduce the first term on the right to the same form as (xii), we put y = (x + 1), 
в = (s + 1), m = (n + 1) and u = (c + 1) so that и = 1 when c = 0 and и = m when с = n, 
whence 


с=п u=m 


bs (c + Dis — 6-2 = 3 um — t)z- wy 
e=0 =< 
Since uy, = 0 when u = 0 
У (+ Verne — с-а = 2X u(m-— Way = (т + Yess 
c=0 uso 
can 
. > (c + aso — с),-„ = (n + 2),+». 
с=0 


Hence in virtue of (xii) above, (xiv) becomes 


с=п 


Ў €. Ca — c)s- = (x + D(n + 2), зә — (n 4- Doi» . + (ху) 


с=0 


1.08 THE GENERATING FUNCTION AS A GRID OPERATION 


To the beginner the generating functions touched on in Chapter 6, Vol. I somewhat savour of 
being wise after the event. They cease to have an air of mystery when we recognise them as 
devices for summarising the operations of the independence grid (Fig. 87). When we lay out a 
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Difference as a Sum 
pe 3 


PGF. of (5*4)fold Sample Ns of 
Row Score-Sum t 5-fold ond  4-fold Samples 
ар ot at? ot? at^ at? ot оё ај ај? 


Fic. 87. Probability Generating Function for Score-Sum and Score-Difference as a convention for labelling the 
cells of the chessboard. 


grid with border scores 0, 1, 2... etc. with corresponding frequencies tg, щ, из . . . etc. 
and 0, 0, Uz . . . etc., a cell Mie score-sum entry is s = a + b is one whose frequency entry 
is Уеа) = Ue- 0: and the total frequency of s for the 2-fold sample is the right-left 
descending diagonal sum of all such cell entries, as set forth in the following schema for the 
score-sum (s) of unit samples from each of two 4-class vniverses with score range 0-3 : 


0 1 2 3 
чо иу и, us 
s=0 s=1 $22 s=3 
0 | Yoo = Uovo Уо = иү® ую = шуш Уз = tst. 
s=1 s=2 s=3 s=4 
1 v| dor = шл Уп = um уа = uW, уза = шй 
s=2 s=3 s=4 s=5 
2 бф) Ууз = Mots Уа = We Уз = Mave Уза = Usa 
s=3 s=4 s=5 s=6 
3 us| Yor = tors Уз = tts Yas = шз Уза = ust. 


As they appear in the grid lay-out the frequency cell entries y; 2) (= Uz . Us-<) lie diagonally 
as on the left below. We can bring all terms of a diagonal referable to the same score-sum s 
into line vertically by sliding the rows as on the right : 
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Yoo Ую Yz Уз Ую Ую Ую Ую ·· 
Ул Уп Уп Yar >а Уц Уп Xm + 
Yo Ую Уз Уз ++ ++ Ja Уз Ja Уз 


Jes Уз Уз Уз Уя ав, > Ув Уз Уз Уз 
Тау: КУ, ЛУ, "yb Ya ym туг 
The formula for the frequency of the score-sum s is then 


2-: 
Е TAE 
z-0 

This exhibits the result of applying the product rule as a lay-out on all fours with the familiar 
algorithm of multiplication. Indeed, the earliest commercial arithmetics set out gridwise the 
procedure for multiplication with the Hindu-Arabic numerals ; and indicated the diagonal totals 
at the margins. Each such diagonal sum is then a factor of the corresponding power of 10; 
and we can make the procedure more explicit by attaching to each border-score frequency y; 
a dummy factor £^ whose exponent is the corresponding score х. When we then apply the 
product rule, the cell frequency y, carries along with it a factor ? whose exponent is the corre- 
sponding score-sum cell entry s. "hechessboard operation for thescore-sum of any 2 independent 
samples then assumes the compact form : 


uut ue ust? um? 
vot’ Yoot® уш? d ET 
vr Yot уп? Yat? Yat 
vat? Yot Vat Vaat Уз 
vst" Уо? Уа узб Yast 


If the border frequencies in this lay-out refer to a unit sample distribution from different 
universes of 4 score classes, we define as a probability generating function of one or other universe 
each with the range 0-3 : 


(uot? + uf! + ust? + изі?) and (vot? + vt! + vet? + 030). 
We then specify a corresponding probability generating function of the 2-fold sample score-sum 
as: 
(У, + Yit! + Yatt + Y, + Yatt + Ү + Yarn 
= (Uot? + шй + ust? + ust?) (out? + ©! + vat? + vs). 
If we take the samples from the same indefinitely large 4-class universe without replacement or 
from any 4-class universe with replacement, the above becomes 
Y, + Yat! + Y, + Yat + Yatt + Yu + Ү = (ust? + и + ust? + ust?) 

By successive application of the chessboard operation, the appropriate p.g.f. of the r-fold sample 
score sum is 

(uot? + ші + ust? + ut) = Yot? + Yit + Yat... У. 

In any of the foregoing expressions the coefficient (u+, v, Y,) of ё is the frequency of the 
score x. By inserting the dummy factor £* in the operation for deriving the score-sum distri- 
bution, we can pick out the frequency of a particular score-sum without invoking the chessboard 
lay-out. 
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Example 1.—A tetrahedral die has on its four faces 1, 2, 3 pips in the ratio 1:2:1 as in Fig. 70 
of Vol. I. The unit sample frequency distribution is therefore $, 3, 1. Hence a p.g.f. of the u.s.d is 
fi +484 8 = Қа 4 24+ 0). 
To obtain the frequency of a total score of five in a 3-fold toss we write 


ae +224 p= E + GH + 1565 + 20 + 157 + 685 + 29). 


The coefficient of £5 in this expression is 15.4~* which is the frequency of the score-sum 5 or the 3-fold 
sample mean score of $. 
In general, we may define a generating function (G,) of the unit sample distribution 


(и, и, иь... и,) of (n + 1) score classes thus 
Gu = uy? + шй + иі... и". A * * . (i) 
Since u, = 0 for values of x exceeding n, we may write this as 
=o 
C= > us. 
z-0 


If the frequency of a score-sum x, in the a-fold sample distribution with replacement is a, and 
that of x, in the 5-fold sample is b,, the corresponding generating functions of the samples are 


Cone Sar аба Ges T bt. 


The product rule for independence then signifies that the corresponding generating function of 
the distribution of the score-sum s = (x, + хь) is 


т= о 


Gira + а) = G(s) = Gia) -Ced У sf. . . . fii) 


z-0 
If we write G,(s), G.(s), etc. for the p.g.f. of the score-sum of 2-fold, 3-fold, etc. samples Ga(s)= G2, 
Суз) = Сї. Gu = G3, etc., and in general 
GAs) = С and С(х, +x) = 62.62 . : 4 . (iii) 
Example 2.—For sampling from an infinite 2-class universe С, = wu, + шй = q + pt, whence 


rer 


Gs) = (q+ Pty = У 1-47 p.t. 


z=0 


In this the coefficient of f? is the familiar result for the sample-score x. 


Example 3.—What is the frequency of a mean score of 3-5 if we toss an ordinary cubical die twice ? 
The score-sum is then 7 and we have 


G, = Pc Peces 
G5) = +++ ETETEN] 
EEVEE ean p an + 5+ LL) 


In this the coefficient of f? is 6 + 36 = }. 


* * * * * * * 
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If a, is the frequency of the score x, in the a-fold sample distribution, it is also that of the 
mean (or proportionate) score (x, + а), and we can adapt the foregoing definition of the p.g.f. of 
the score-sum to specify the mean (or proportionate) score frequency by substituting the dummy 


z 
factor ta for £^, so that а, is then the coefficient of the t-term whose exponent is the mean score 
itself, ie. 


z= 


Ce) = 5 aJ к. Wt e e erc iv) 


z=0 


We should then write for the multiple toss of the cubical die 
1 
буз) = zË dort) 


We have so far assumed that our unit sample scores increase from zero by unit steps. If 
they increase from т by equal steps Am, we may interpret и, as the frequency of the score 
m + xAm in the p.g.f. 

Gy = uj" + u mt am pu mtióm S, ne te З $ 9 


In the a-fold score-sum distribution the minimum score will be am and the corresponding p.g.f. 


will be 
G(x,) = ај" + attan + aj *?^^ etc. . а . (vi) 


For the corresponding proportionate or mean score, the f.g.f. will then be 


Am 
o(®) = ay? + a," cat hy E „шз. 4 5 . (vii) 


Example 4.—The scores оп the faces of a tetrahedral die are 2, 5, 5, 8, i.e. 2 + 0(3), 2 + 1(3) and 
2 + 2(3) in the ratio 1: 2:1, so that 


G, = hep 284 e) e Dec oe + ) = Tet Py. 


For the a-fold sample score-sum : 
ya I 
Gs) = Gr — (o + f) - 0^ > Calf. 
If the score-sum is 15 in a 3-fold toss, а = 3 and the relevant term in the expansion is the one whose £ 
exponent is (2a + Зх) = 15, so that x = 3, whence 
Uo dL ыб, 
3131 64 16 


аз = (2a), . 27^ 
* * * * * * * 


We may now generalise an important result already obtained in Chapter 7 of Vol. I. We 
may define a binomial variate in the domain of representative scoring as such if the frequencies 
of score values m + xAm increasing by equal steps Am in the range т to (m + kAm) tally with 
terms of the expansion (q + p)*. 

G, = "g + pr^"), 
s. G(x,) = "(0 + pt") and С(х + хь) = t^ * "(g + мА +9, 
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Thus the frequencies of the score-sum am + xAm in the a-fold sample tally with successive 
terms of the expansion (g + p)**. We may express this by saying that a binomial variate defines 
the distribution of the score-sum (and mean score) of samples of any size from a universe of which 
the u.s.d. is a binomial variate. If the variance of the u.s.d. is Ард, that of the a-fold sample 
score-sum distribution is akpg. Hitherto, it has been our custom to lay out the grid for the raw- 
score difference (d) of independent a-fold and 6-fold samples, as below (а = 4, b = 3): 


0 1 2 3 4 
и, ш и, из щ 
d=1 d=2 
0 w Уо = шу эн = gto 
d-0 d=1 d= d=3 
lu Уп = uw, Уп = ш Уза = шо Уа = ш 
d=-1 d=0 d=1 d=2 
2 v Уза = Vs Yaa = Mada Yaz = Mata Уа = Me 
d--2 d=-1 d=0 d=1 
3 v Уз = Us Уза = шз Yaa = ust. Уз = що 


The rule for the individual cell entries y;; = u,v; is as before but the rule of diagonal summation 
for the particular difference d is different from the rule for the sum (s) being 
jaa dad 
> Uar = Ya = > Masi 
j=0 j=0 


If the maximum value of u; is u and that of v; is v the range of d is from — v up to + u, as from 
— 3 to + 4 in the foregoing schema. For which we may write the generating function of the 
difference as 

Үш + Y. ,t3 + Yatt + YW + ҮЙ + Ys + Yat + Yeti 


More generally, for the difference d = (x, — x») of two independent variates 


d=u 
G(x, — х) = > Yt. 
а=. 
Now we may write the difference d = (x, — хь) as a sum, viz. : d = x, + (— х). If, as Fig. 3, 
we lay out our row border-scores as negative values reversing the sign of the exponent of the 
attached dummy t accordingly, we may define a new g.f. : 


G(— хь) = bot? + bit! + bat? + bat? . . . etc. 
As before we write the g.f. of the column border-scores 
G(x.) = au? + at) + ast? + ай... etc. 
Whence we have 
d=u j=d 
G(s).G(-:2)9 > У «4.b." 
а=. j=0 
d=u 
EVI 


d=v 


(к). G(— хь) = G(x, — xi) pol ка с 
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For the unit sample difference universe of (л + 1) score classes we may write for brevity 


zao T 
с. = > ил" and С. = >й tt. 
т=0 z-0 


The distribution of the b-fold sample is obtained by expanding С? of which the terms are identical 
with those of G^, if we reverse the sign of the exponent of the dummy 7. If x, is the b-fold 
sample score from such a universe we may therefore write 


G(— х) = G*,. 
As before, С“ is the g.f. of the distribution of the a-fold sample score (х,), so that Gi = С(х„) and 
G(x.)G(— хь) = G(x, — хь) = С.С. 
If the samples come from different universes we may write this in a more general form as 
G(x, — %) = G2. G^, 
= (и + ut! + ut? . . .)%(09 + vtt + Ot? . . .) А А (ix) 
Example 5.—For the distribution of the raw-score difference between a- and 5-fold samples from an 
indefinitely large 2-fold universe 
G(x.) = (q + pt) 5 G(— 1) = (q+ pt?) ; 
G(x, — 2) = (g + Pt) (g + pt). 
If a — 3, b — 2, we may set forth the operation as below : 
gt + Зара. + Зар? + pe 
gt + gpi рч 
gt + 34р + 3q%p*t? + дрэ 
2Qq'pt + 64р + 6GP + Qopit? 
qp T 3gpi + 3qp't? + pe 


Whence we derive the following distribution (left) of the score difference in agreement with the chess- 
board lay-out (right) below : 


0 1 2 3 
Ф 34% Зар? Р 
0 1 2 3 
+3 p 0r gr Ф Зар Зар? Фр 
T2 Зар? + 2р“ 
+1 3gp + Gap? +p —1 0 1 2 
0 а +6rp + 3gp 1 29p 2q'p 6gp бар? 2gp* 
—1 24% + Зар" 
—2 фр —2 —1 0 1 


Г 


р | cp aep Зар* Ld 


‘The results summarised in (viii)-(ix) refer to a raw-score difference. They are easily adapt- 
able to the description of the distribution of a score deviation or to a proportionate score, since 
the only function of the exponent of 7? is to label the score itself. "То make them do the task 
required, all we therefore have to do is to label ¢ so that x is in fact the score which is our 
concern. Thus we substitute ^^?! for # in the expressions involved in (viii) if our concern is with 
the score deviation, and 1*/^ for ¢* and t~*” for t~ if our concern is with the proportionate score. 
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For the proportionate score difference (= = *) of a-fold and b-fold samples from an infinite 


2-class universe, we therefore have 
ECT 
6(® -®)- @ + prs)’ la + pt 25) Caa e ^ тү 
For the unit sample from an infinite 2-class universe M = p, X = — p when x = 0 and 
X = (1 — p) = q when x= 1. We therefore write the g.f. of the u.s.d. as 
= (97° + ptt) = t-7(q + pt), 
G(s) = t7 (q + pty’. 


Example 6.—For the heart-score deviation of the 3-fold sample with replacement from a full pack 


(p— 3: 
crt) Bae 


CEE E 1 
Сїй = Ves gu t+ m + 9 + it). 
Thus the distribution is 
Poeti ug 
Y H H W » 


‘The rule for adapting the form of the p.g.f. to take account of Change of Scale and Origin 
is simple. Consider the following score distributions which differ w.r.t. scale and origin alone : 


Score A К Аа m--a m + 2a т + За m -+ 4a m+5a... 
Score B j “Ж qTb q+2b q + 3b q + 4b qt+5b... 
Frequency . . 40 и, Uy и uy Us 


We may write 


© ©. © 
GUA) = sucum == РУ ж. ERR PS uS LM. 
9 o о 


СВ) fug. exon NEG Um 


Thus the effect of multiplying the G, by 1"-* or /*-* is to change the origin from m to (m +k) 
or from q to (q + k) as the case may be. We may reduce both expressions to a form involving 
tbe p.g.f. of the distribution with unit scale and zero origin by putting 

1 


1 
f=h t= and Pap dg 


We then have 
G,(A) = he Su. h® and G,(B)= e$ 
Symmetrical Distributions 
It is a property of symmetrical distributions tbat the distribution of the raw-score sum of 


a-fold and 5-fold independent samples has the same form as that of the raw-score of the differ- 
ence from the same universe, i.e. the only difference between the two being referable to the origin. 


THE ALGORITHMS OF SUMMARISATION 473 
Consider the following symmetrical u.s.d. of a universe of 7 score classes : 
Score 3 .m mcg m + 24 т + 34 т + 4q m + 5q m + 6q 
Frequency ‚ ш ГА из Uy = Uy fig = th tle = Up 
The p.g.f. of the u.s.d. is 


в в 
G, EPI шыш = Dum 
о 0 


== (ugt? 4 uf + ust. + uat + ust? + uat uot?) 


ER ut 4 11° + uat + ust? + иа“ + uut + usto). 


For the distribution of negative scores we may write 
6 6 
С-„= DEL tren == ab a 
9 0 


= Mhu? + mt + ut + ut + ut d t + uot) 
= pE (uum 1. um + uat? + uu? + ust 7 + щі + ust ^). 
In accordance with the product rule the p.g.f. of the raw-score sum s = (x, + xy) of independent 
a-fold and 6-fold samples is 
G(s) = Gs. Gh = {64m tony е + nt... etc.)e+?. 
That of the raw-score difference d = (x, — хь) is 
С(4) = Gi. С? = :e- nmn util etc.) +. 


"Thus we have 
G(s) = nho + Gd). 

As we have seen, the only effect of the left-hand factor in the expression on the right is to change 
the origin of the distribution. This result is easy to confirm by recourse to the chessboard device. 
If the distribution is symmetrical, diagonal summation from left to right downwards is equivalent 
to diagonal summation downwards from right to left in the square grid ; and the student should 
be able to interpret the change of origin in terms of the distribution of the score deviations by 
drawing it. 


EXERCISE 11.08 


1. Acard pack contains only equal numbers of cards of the following denominations : ace of hearts, 
2 of clubs, 3 of spades, the player’s score being the total number of pips regardless of suit. Write down 
the distribution of the 3-fold sample score-sum and that of the difference between 2-fold samples on 
the assumption of replacement, and check the result by recourse to the chessboard procedure. 


2. Derive by means of the p.g.f. the frequency of the following mean scores for a 3-fold toss of 
the tetrahedral dice with faces as specified : 


Mean Score Faces of die 
4 3,4, 5, 5 
5 YS e D 
10 2, 6, 10, 14 


Check the results by the grid procedure. 
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8. Specify distributions of the difference between both the total score and the mean score of the 
3-fold and the 2-fold toss of each of the dice in Example 2 above. 


4. By use of the g.f. involving the dummy factor @ establish the following conclusions w.r.t. 
sampling with replacement from a 2-class universe (e.g. red or black cards of a full pack) when ?—3—4 : 


(a) the raw-score difference distribution about the mean for a-fold and 5-fold samples is the same 
as that of the (a + b)-fold score-sum ; 


(b) the proportionate score difference is identical with that of the raw-score about its mean. 


5. When p and д are not equal in Example 3, show that 
(a) the raw-score deviation difference distribution is identical with that of the proportionate score if 
the size of the sample is equal ; 


(b) the distribution about the mean of the score-sum for samples of 2a cards is the same as the dis- 
tribution of the sum of the differences between a pairs. 


6. For an infinite 3-class universe of score values —1, 0 and 1, write out the distribution of the 
3-fold sample mean score on the assumption that the ratios of the score class frequencies are (a) 1 : 1:1; 
(b) 1:2:1; (c) 1:4:1. Check by the chessboard procedure. 


CHAPTER 12 


MODELS OF BIVARIATE UNIVERSES 


12.00 MEANING OF THE MODELS 


ABOUT the turn of the century Karl Pearson adapted methods of line fitting prescribed by 
Legendre and Gauss for the evaluation of physical constants based on laboratory experiments 
to the description of concomitant measurements of relatives. The ostensible end in view was 
to develop certain confused and erroneous beliefs about inheritance propounded by Francis 
Galton, in deference to whose mystique the Gaussian Method of Least Squares asserted its 
claims in a new context under a new name as regression. Pearson’s new contribution was the 
announcement of a measure of association commonly called the correlation coefficient or more 
precisely the product-moment index. With its aid he claimed to have established on a firm 
footing Galton’s so-called Law of Ancestral Inheritance. This generalisation is meaningful in 
one sense which is true but too trite to have any claims to novelty or to utility. In any other 
sense, it is demonstrably false. 

Through Bowley the new evangel of correlation spread to the social sciences, expounded 
against a background of geometrical concepts which defy any attempt to make explicit the 
manifold circumstances in which co-variation may arise. Not unnaturally the social sciences 
have therefore laboured under a load of misconceptions from which the revival of Mendel's 
experimental method rescued the study of heredity in plants and animals. 'To make explicit 
circumstances relevant to a correct assessment of observed correlation is therefore a task of no 
mean importance. It is indeed a simple matter, if we examine different types of model 
situations. By examining one such class of models in Chapter 9 of Vol. I, we have seen that 
correlation in the statistical sense entails no necessary conclusions about the causal nexus involved 
in the events recorded. We shall appreciate this more clearly if we now take stock of some very 
diverse situations in which correlation can arise. Such is our chief concern in what follows ; but 
the situations we are about to explore may prove to be misleading if we do not clearly appre- 
ciate in what sense each model dealt with is a universe in contradistinction to a sample such as 
we meet in sociological or biological research. 

In our first approach to statistical theory it is appropriate to regard the structure of the 
universe (e.g. a card pack) as the source of our information about samples (e.g. hands at bridge) 
drawn therefrom ; but we have anticipated a different viewpoint in so far as we have found it 
(a) necessary to draw a sharp distinction between die or lottery wheel models and card pack or 
urn models in Chapter 2 of Vol. I ; (b) convenient to speak of the score-frequency specification 
of the universe as the unit sample distribution. We shall be better able to appreciate the lesson 
of the models dealt with in this chapter if we first re-examine our use of the terms universe and 
sample. 

From a static viewpoint we may usefully distinguish between universes of 3 kinds : 

(i) discrete and finite, if there is a finite number of score classes each with a finite number 
of identical score values, e.g. a full pack of 52 cards of which 13 (score value 1) are hearts 
and 39 (score value 0) are of other suits ; 

(ii) discrete and infinite, if we pool an infinite number of full card packs, in which event 
there is a finite number of score classes each with an infinite number of identical score 
values, subject to the understanding that the ratio of two such infinite numbers is 
specifiable and finite ; 
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(iii) continuous, in the sense that the number of score classes is infinite and the number of 
items in each class is infinite though not necessarily equivalent on that account. 


The last named is a convenient mathematical fiction which at least serves a useful purpose 
as a means of simplifying laborious computation with sufficient accuracy for practical purposes, 
e.g. when we invoke the normal curve to specify the distribution of large samples (Chapter 3 in 
Vol. I) from a 2-class universe of type (ii) above. Likewise it is often a convenient device for 
specifying the structure of a discrete universe of the same type when the number of score classes 
is very large. Whether it is more than a fiction is open to philosophic doubt; and we are on 
solid ground only if we confine our attention in this context to (i) and (ii). 

If we define our universe as both finite and discrete, we cannot specify the results of sampling 
from it unless we agree at the outset concerning whether the sampling process does or does not 
involve replacement of each item chosen before taking another. If we impose the condition 
of replacement, the distinction between (i) and (ii) ceases to be relevant from a mathematical 
viewpoint, since sampling with replacement from one full card pack is equivalent to sampling 
without replacement from an infinite number of full card packs. 

When our model universe is an urn or a card pack, we are always free to regard it as an 
entity in its own right on the assumption that we are free to sample one way or the other; but 
we cannot appropriately conceive the model universe of the die or lottery wheel in this way. 
By its very nature, such a model is a widow's cruse. However often we toss a cubical die, it is 
still possible to score a six at the next trial. Thus, the structure of the model is such that we must 
in effect impose the replacement condition on the sampling process and therefore conceive the uni- 
verse of the model as a universe of type (ii) ; but in making any such statement about our model 
universe we have changed our viewpoint. If we view a penny as a static entity, we are entitled 
to regard it as a 2-class universe with 2 score values ; but such a picture of the universe might 
lead us to wrong conclusions about its behaviour, if the penny were biased. To visualise it 
correctly with that end in view, we must think of it as a universe in action. We have then to 
conceive it as a 2-class universe with an infinite number of score values, the ratio of alternative 
score values being unity if the penny is unbiased. 

To say that we must so conceive it as a universe in action is to say that we have reversed the 
more naive procedure of deducing the nature of the sampling distribution from the structure of 
the universe. We are now conceiving the nature of the universe in terms of the sampling pro- 
cess. 'This is the readjustment we have to make, if we seek to visualise sampling in what we shall 
later define as a correlation universe. To do this, let us recall a simple example of the class of 
model situations dealt with in Chapter 9. Тһе umpire tosses a coin twice, each of two players 
(A and B) toss once, each adding the umpire's score (heads) to his (or her) own individual 
scores. We may summarise grid-wise the players' joint score distribution in an zndefinitely 
large number of trials as below (as in 11.01, p. 429) : 


Xa 


0 1 2 3 
0 1 H | 0 0 
H 1 3 2 0 
хь | 
2 0 2 3 1 
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ach set of border-scores and the corresponding row or column totals (not shown above) of such 
a grid defines a univariate (single score) unit sample distribution, being thus a summary of 
the relative frequencies of recording each score value in an infinite number of trials. In other 
words, each border-score distribution defines a particular universe of scores. "The cell entries 
of the grid exhibit how often a score of one set turns up with a score of the other set in the long 
run. As such, they summarise the relative frequencies of the paired scores (xa, хь) in an infinite 
number of trials, each cell entry (divided by the grand total) being the probability of getting a 
particular paired score at a single trial. This is what we mean when we speak of a bivariate 
unit-sample distribution. Since it summarises the outcome of an infinite number of independent 
trials, such a distribution describes a universe from which we may extract samples of any number 
on the assumption that the particular paired score-value obtained at one trial (unit sample of 
paired scores) does not affect the paired score-value obtained at the next. To say that the 
universe is infinite in this context is, of course, consistent with saying that it contains a finite 
number of classes. In the same sense, we have seen that the universe of the common cubical 
die is both discrete and infinite. ‘The number of faces defines the relative frequencies of six 
classes each with an infinite number of items available for withdrawal as sample values. 

Only a sample composed of 16 or some exact multiple of 16 paired scores could be speci- 
fiable by exactly the same proportionate cell entries as the bivariate universe of the bonus model 
mentioned above ; and this would be a very rare occurrence. In general, the sample structure 
prescribed by, say, 8 successive trials may be specified by filling in the cells with integers up to a 
total of 8 (or exact multiples of one-eighth up to a total of unity) with the proviso that certain 
cells whose corresponding theoretical frequencies are zero remain empty. In the above, these 
zero cells are, of course, defined by 0.2, 0.3, 1.3, 2.0, 3.0, 3.1. Thus 3 possible 8-fold samples 
are as below: 


0 0 0 | 0 0 

2 | 0 о [2 [а DU Ж ЕА 

0 2 0 2 2 о 4 0 0 
o|2 0 | 0 of o 

Ta = +1 Ta =O fa——l 


Of many possible 8-fold samples one might choose, the above illustrate the possibility that an 
actual sample may ring the changes on values of 74, from perfect negative through zero to perfect 
positive correlation, and hence bring into focus a twofold problem about a correlation universe : 


(a) what sample parameter is an unbiased estimate of the product-moment index ra, in 
the sense that (r — 1)s* = ro? defines the unbiased r-fold sample estimate (p. 304, 
Vol. I) of the variance (o) of a univariate unit sample distribution, i.e. universe of single 
scores ? 

(b) how can we define the sample distribution of r,; or other characteristic parameter, e.g. 
Ry, or Cov (xa, хь) ? 


At this stage, we shall not attempt to answer these questions, stating them merely to em- 
phasise the importance of the distinction between 7», etc. conceived as parameters of a correlation 
universe (unit-sample bivariate distribution) and as parameters of a particular sample of observa- 
tions. In the exposition of the models in this chapter our concern is with the specification of 
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[Ei a) 
a) HJ ы NJ 


PROPORTIONATE SIZE OF PILES OF CHIPS FOR PLAYERS’ JOINT SCORES N A VERY LONG SEQUENCE OF TRIALS 


T [s Тоо] pM 999 -= [o] 
ој ој 1941010] 0] 11210] agg О 

oj Lolojolo} [Оооо [®][е][е] [е] EE 
isi fo} [clclolo] [боо оро] Бр 


BELOW - GRO OF RELATIVE FREQUENCY OF PLAYERS JONT SCORES IN ENDLESS SEQUENCE OF TRIALS 


(sample distribution of the толе normal verte of see] 


SCORE OF PLAYER A (Xo) SCORE OF PLAYER A [XJ 


np c Nw тш o 1. 22 


SCORE OF PLAYER В (XJ 


SCORE OF PLAYER B (x) 


Fic. 88, The Unit Sample distribution of a bivariate universe. 


the former. The model may summarise the long-run outcome of all possible unit trials repeated 
indefinitely, and indeed (12.01-12.06) we can profitably conceive the structure of a bivariate 
universe only by such a backstage approach, viewing the summarising grid as a unit sample 
distribution in that sense. 

‘The grid lay-out itself is only one of several different ways of specifying such a universe. 
As we have seen in 11.01, we may do so for the universe of the model mentioned at the 
beginning of this section as follows : 


X,.x,: 0.0 01 1.0 11 12 21 22 23 32 33 


. 3 = ERAT 
X: 15 de dk de Ye 16 15 15 ds dk 


The arrangement shown above has one advantage in that it falls into line with the lay-out of a 
univariate unit sample distribution. The circumstance which distinguishes the universe of 
correlation from the universe of independence is that the same numerical values of x, do not 


occur with equal frequency among different values of x, as they would if the distribution were 
the following : 


0.0 0.1 02 03 10 11 12 13 20 21 22 23 30 31 32 33 


1 
Ys ҮЕ de 15 15 15 15 18 15 15 re is 15 15 15 15 
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HOMOSCEDASTIC DOMINO MODEL 


Ls [| 3 |з |з | 3 [wo 
Е а Ее] v ues 


М =1= ү; М3 = М, ; Соу (x, x,) = О 
Fic. 89. А bivariate universe which has zero covariance апі homoscedasticity (equality of variance within arrays) 
in both dimensions. 


It is important to recognise the implications of the fact that the two distributions set forth 
above each represent the distributions of independent unit samples, i.e. trials. When we speak 
of one as a correlation universe and the other as a universe of independence the distinction 
refers to the way in which the A-scores are distributed w.r.t. the B-scores (or vice versa) among 
unit samples of paired scores; but when we prescribe the relative frequencies of r-fold samples 
from a universe of either sort, we do so on the assumption that one trial is independent of another 
in conformity with the usual chessboard procedure. In short, we can visualise our bivariate universe 
as both finite and discrete, if we impose the condition of replacement on the process of sampling 
therefrom. 

We may suppose that the umpire has a large box of dominoes of 10 denominations, the two 
halves of each domino being respectively white with black pips and vice versa. Instead of writing 
down the score at each trial, the umpire may draw from the box a domino with the appropriate 
number of white pips on black for the total score of player A and of black pips on white for the 
total score of player B. As the contest goes on the pile of each of the ten types grows, and as 
the number of games becomes indefinitely large the proportions of dominoes in each pile become 
ever closer to the distribution assigned by the grid. From a formal point of view, the long-run 
result would be exactly the same if we recorded the result of taking dominoes with replacement 
one at a time from a box of only 10 dominoes of the same ten types in the same proportions 
(Fig. 88). "This is a convenient visualisation inasmuch as it helps us to see one way of constructing 
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a distribution of which (Fig. 89) we can predicate both zero covariance and homoscedasticity 
(equal variance within arrays) without imposing the additional restriction that the two score 
distributions are truly independent in the statistical sense of the term. 

One feature of Fig. 88 calls for special comment because it introduces a device which will 
later (Chapter 18) steer us through a maze of difficulties in the theory of sampling from a bivariate 
universe. Since each of the dominoes, i.e. players’ joint score chips, of Fig. 88 records the result 
of a single trial, we can visualise the trial as a grid with a single cell entry in the appropriate 
row and column, otherwise constructed like the summarising grid of the unit sample distribu- 
tion (u.s.d.). Since each trial is independent of another, we can operate with such unit grids in 
accordance with the chessboard lay-out, successively deriving the distribution of 2-fold, 3-fold, 
etc. samples by applying the product rule, at each stage specifying the composition of the 
(r + 1)-fold sample of frequency so defined by adding cell by cell the entries of the unit grid to 
that of the r-fold sample grid. ‘Thus the following shows the generation of a particular 2-fold 
sample : 


1 TEE 
EE IER 

ў 1 ў 
паше т» Бале 

foo = Ve fu = їс = 
1 * 
1 
T 
М =з Soo = Ys 


EXERCISE 12.00 


1. Each of a pack of cards carries 1, 2 or 3 hearts on one face and 1, 2 or 3 spades on the other in 
the following proportions : 
1H 15 р 2H 15 s 3H 1S v 
1H 2S q 2H 2S t 3H 2S w 
1H 3S r 2H 3S u 3H 3S z 


Examine the properties of the unit sample distribution for the following values p, q, etc. with special 
reference to the row and column means, the row and column variances, the values of 75 iq and Tap : 


b q f $ t u v w z 
(a) 1 0. Oo —2.. Ж 2 0 0 1 
(b) 0 1 0 1 2 1 0 1 0 
(с) 1 m 0 2 2 2 0 1 1 


2. Work out the distribution of 2-fold samples for (a)-(c) above. 
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12.01 Tur Umpire Bonus MopEL 


In Chapter 9 of Vol. I we have examined a type of correlation which arises between the scores 
(x, and хь) of two players A and B in a game of chance, if each receives a variable bonus (x,) 
from a third player called the umpire. In Chapter 18 we shall rely on the same model to 
clarify the elements of the statistical procedure called Factor Analysis. For that reason, 


we shall now examine it in more general terms, Fig. 90 exhibits a simple variation of the 
model, viz. : 


UMPIRE BONUS MODEL 


4 64 
HIERERERERESIEEESEEE 
w[s[z[s]a]a] СЕ 


мм)» 8: VIM) 8: MOa) = УМ) = d 


perd By М) + V (Mag) = 1M (og) + ум) E 
Sey AB) = d =v, 
4 
Vite) lg ы. 4 

Prayer B 

KD 

A 

SCORES FREQUENCIES 


Frc. 90. Umpire Bonus Model—linear regression in one dimension only. The umpire tosses twice the flat, 
circular die of Fig. 67, Vol. I. Player A tosses once the tetrahedral die of Fig. 70. Player B tosses once the tetra- 
hedral die of Fig. 73. 

(i) The umpire tosses twice the die of Fig. 67, Chapter 7 ; 
(ii) Player A tosses once the die of Fig. 70, Chapter 7 ; 
(iii) Player B tosses twice the die of Fig. 73, Chapter 7. 
In such a situation we note that the scores (x,., and x,.,) of the individual players A and В 
before addition of the bonus are strictly independent of one another and of the score of the 
umpire. We express this by the equations 


Xa = Xu H Xa.o and x = X, + 8. d Б е ау 


482 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 
We may speak of (i) as a law of linear concomitant variation in contradistinction to a situation 
in which the law is curvilinear, e.g. cubic, as when A receives a bonus x, and B receives a bonus 
i; Le 
х„= х. F Xa.o and хь = 4 х. E 5 А =й) 
By recourse to constants (А,, Æo, By, В,) we may subsume both (i) and (ii) under a more 
general expression 
Xa = Ах? + Ах... and x, = В, + Bory.o А К . (ii) 
When р = q we may speak of the relation as linear, (i) being a special case arising when р, g, and 


the constants А, etc. are all equal to unity. Thus we might devise the following game in which 
the players’ chance of success is equal and the law of concomitant variation is linear : 


(i) The umpire tosses twice the flat circular die of Fig. 67; player A tosses twice an ordinary 
cubical die and player B tosses once the tetrahedral die of Fig. 70, so that the mean scores of 
the umpire and individual players before receipt of bonus are respectively M, = 3, M,,,— 7 
and M, , —2; 


(ii) Player A counts as his final score 4 times that of the umpire added to twice his individual score, 
B recording as his final score 6 times that of the umpire added to 4 times his own individual 


score. 
In this case the law of variation is 
Xa = 4х, + 2х... and x, = бх, + 4%... 
For the means we have 
M, = 4M, + 2M,., = 26 = 6M, + AM,., = Mp. 


Let us now derive the product-moment index appropriate to (iii) when p = Lag We 
may then write 

M,—A,.M,4- A,.M,., and М= Bu. M, + Bj. M... . . (v) 

V,=A2.Ve+A2.Vq.. and Vy= B}. Va + Bi Voo < (9 


From (iv) we have 


x, — M, = Ax, — My) + Adl¥a-0— Ma-o)s 
xy — M, = Вх, — My) + Bx. — Mo.0) 
In conformity with the convention used elsewhere we may write these in terms of score 


deviations as 
ZSA X. X... and Xe BAL +B, Xy. « . (vi) 


„. XXV = А„В„Х? + А„В„Х,„. Xo. o + А„В„Х„. Xa.o + А„В„Х„.„. Xoo 
^. Е(Х„Ху) = А,В, E(X2) + А.В, Е(Х,. Х,.„) 
+ А,В, E(X, . Xa. 0) + А,В, Е(Х„.„. Х,.), 
у. Сое (Xas хь) = AyBy V, + А,В, Coo (xv, хь.) 
+ А,В, Cov (Xw Xa. o) + А,В, Cov (xs. or Xo. o). 
Since Xa. os X». o ANd x, are independent, their covariances are zero, and 
Соо (x, хь) = Ay. Bu- Vu. 


MODELS OF BIVARIATE UNIVERSES 483 


When A, = 1 = B,, this reduces to Cov (xa, хь) = V, as we have seen in Chapter 9 of Vol. I. 
For the more general case we may write 


Tay = = ——.—— . a P Я . (vi 
a V V.V, Oa оъ ба) 
"То determine the covariance of the players’ score and that of the umpire we note that 
XX, = X(A,X, + A,X,.)) = А„Х + AXXa. o 
^. Cov (xq, хы) = AyE(X3) + A,E(X, . Xa. 0) = A, . Vu 
Whence we obtain 
TEC E it) 
9.0 Oa 
Similarly, we derive 
ты = Be, 
2 
ENT fis Ec М Be Xf Я я n « (x) 
[^ оь 


In connexion with the derivation of the equation of partial correlation and the meaning of the 
“ reliability ” coefficient іп 18.06 below we may usefully elaborate our model, as in the following 
examples : 

Example 1.—Umpire U tosses an ordinary cubical die once. Umpire W tosses a coin twice 
(scoring heads as 1 and tails as 0). Player A tosses the tetrahedral die of Fig. 70 (scores 1, 2, 3 in the 
ratio 1:2:1). Player B tosses once the tetrahedral die of Fig. 73 (scores 1 and 2 in the ratio 1:3). 
The final score of A is twice his individual score added to 3 times the score of umpire U and four times 
the score of umpire W. The final score of B is three times his individual score together with twice 
that of umpire U and 5 times that of umpire W, i.e. 


Xa = Зх, + A2, + 2a. 05 
Xy = 2x, + 5х, + Зх. o 
Example 2.—Umpire U tosses a cubical die once. Player A first tosses the die of Fig. 67 twice, 
and then tosses once the die of Fig. 70, counting as his individual score 4 times the result obtained with 
the circular die added to the result of tossing the tetrahedral die. Player B tosses the die of Fig. 73 
once, and adds to 5 times his score the result of tossing a coin twice, the sum being his individual score. 
The final score of A is three times that of the umpire added to his individual score. B adds to his 
individual score twice that of the umpire, i.e. 
Xa = $х„ + 4ш, + Xu; 
My = 2, + Sipa + Хв. 
In Example 1, we have two independent umpires, and we may write the general pattern as 
Xa = Ах, + Auto + Аха. о; ty = Buty + Butw + Boso + + (X) 
In this set-up 
M, = AM, + AM, + А,М,.,; М = B,M, + В.М, + BoMp.03 
Va = АУ, + АУ, + Aue; Vo = ВИ, + BoVu + ВУ. о. 
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Hence we may write 
X, = А.Х, + А.Х, + AXa.03 Xo = В.Х, + В.Х, + В,Хь., 
Cov (xa хь) = Е(Х„. X») 
= A,B, E(Xi) + AuBwE(Xp) + (А,В, + AwBu)E(Xu . Xu) 

+ ALBE(X, . Хь.) + AvBoE(Xw - Xoo) 

+ A,B,E(X, . Xa.0) + А„В„Е(Х„. Xa.0) 

+ A,B, E(X,., ..Xs.,), 

os Cov (Xas ху) = A,B,V, + AvBuVe, 


КОКЕ Bee DE a, v NEED 
Oa Oy са Op 
Similarly we get 
Cov (Xas Xu) = А.У, and Cov (xa, xv) = А.Г, 
A. f tm XE and fay = ee 
Oa Oa 
Likewise 
ты = Bot and n. By. 
оу сь 
Whence we obtain 3 
oz o 
Tau Tiu + Taw Too = AyB,— + AvBu—, 
[^ [^ 
7. Таъ = Tou -Yiu + Taw+Tow — . . . (xii) 


We may accommodate negative correlation in the simpler set-up defined by (vi) if A, and B, 
have opposite signs, as when 4 adds the appropriate bonus to his individual score, and B deducts 
it therefrom. The covariance will then be negative. The set-up defined by (x) admits the 
possibility of zero covariance, if A,B,V,, = — AwByV in (xi). If the umpires toss the same 
die the same number of times, so that V, = Vw, zero covariance therefore implies that 


A, By 


A. BY 
The orthogonal lottery model of Fig. 13 in 12.07 below is a particular case, viz. 
A,=B,=1=Ay, B, 1 and A,=0=B,. 
In the jargon of factor analysis, Example 1 illustrates a situation involving two scores sharing 


two common factors. The second example illustrates a situation involving a common factor 
and two independent specific factors. Example 2 is of the general pattern : 


= Atu + Aas H Aaa and xy = Вх, + Baoa tH Betre (xiii) 


The reader will easily see that 
Cov (Xas хь) = A,B.V, ^ : = 4 . (xiv) 


V, = AV u + АУ... + AV... and У = BWV, + BIA. BW... . (ху) 
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An important generalisation developed in 18.06 below emerges from a modification of this 
pattern when the player plays against himself by repeating at each trial his prescribed number of 
tosses with the third die, and adding the result of the single toss of the first and of the second to 
each. If the player (A) does this, he has at each trial 2 scores : 

х= Ay, + Ах. a H Aden 
Xa = Амы + Ao. s HAien 
This conforms to the pattern of Example 1 with the special condition that V,., = V, = V,.s, 
and we may write 
Cov (s а) = АФУ, + АУ, 
V, = Ау, + A;V, 4- АУ, = V, : А . (xvi) 
Whence we have 
s AV + AV, m 
Our numerical examples in Chapter 9 of Vol. I have shown that linear regression in neither 
dimension of the grid is a necessary consequence of linear concomitant variation in the domain 
of the concurrent relationship between the scores of the two players when Example 1 defines the 
set-up. Contrariwise, they also show that there is always linear regression of the player's score 
on that of the umpire. To show that this is always true, we shall first consider the case which 
arises when : (a) the player's individual score and that of the umpire each increase by unit steps 
from zero upwards; (b) the definitive equation of the A-score is x, = x, + хы... For this 
set-up Cov (Xa, Xu) = V, and 
LN 


Tou = 
Fo, Fy 


If regression is linear, the identity defined by (vii) of 11.04 then implies that 


Ta fim 

Mn Tw =) ES . x ` 5 . (xviii) 

Let us first recall the build-up of the correlation grid for the concomitant score distribution of 

player and umpire by reference to a simple example, viz.: the player A tosses a penny twice 

and the umpire four times, the player's total score being the sum of the player's individual score 

and that of the umpire. If p is the probability of scoring a success in a single toss, we may 
denote the distribution as follows : 


Score Frequency 
З Player's 
Сток individual score 
0 u= ф а= Ф 
1 m = 4рр a, = 2pq 
2 и, = бр a, = р? 
3 u, = 4p*q 
4 u= рї 


For a fixed umpire score of 0, 1, 2, etc. the total A-scores run (0, 1, 2), (1, 2, 3), (2, 3, 4), etc., 
or more generally for a U-score of r the range is from r to (r + 2) with weighted frequencies 
U, . ao, и,.а and и,.а. Тһе frequency grid is therefore as overleaf. 
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A's Total Score 
0 1 2 3 4 5 6 
[] Ф 2р pu 0 0° 0 0 
1 0 Apq* Sp*g* арф 0 0 0 
Umpire's Bonus 2 0 0 6p*g* 12p%q* 6p' 0 0° 
3 0 0 0 арф Sptq? 4p q 0 
4 0 0 0 0 p'è 2р% 2" 


A-score frequency Га 6ра° 15р? 20р? 15p'g* | бра р” 


When the two sets of independent scores both increase by unit steps from zero origin and 
the player's total score is simply the sum of his individual score and that of the umpire, we may 
generalise as below the preceding pattern to accommodate situations involving the use of different 


dice by the player and the umpire : 
A's Total Score 


0 1 2 3 4 
O ша Ug Mods ods ша, 
Umpire's 1 — ща, ша щаз ща; 
Scoe 2 — — шау иза иа, 
3 um =, Е “зао из 


If the player's individual score increases from 0 to z by unit steps, its mean value is 


M,., a0) + (1) + a2) . as) = >. a.m "E Nux) 
т=0 
By definition also 
aot aata.. o Ба, = S уш 


For the rth row of the grid the mean A-score (Ma. ,) is 
u,. ar) +u,- alr + 1) + u,. ar +2)... u,. adr + 2) 


M... Uy. y+ ü, . ay + Uy. Gg... Up. Ae 
afr) + ar + 1) + ar + 2)... air + ғ) 
z=: z=: 
=r У Gst > а,. х, 
z-0 z=0 
i Mpt Maa >. с a 


In this expression r is the umpire's score and M,.,is constant. Thus the mean A-score of a 
row is a linear function of the border U-score. "То arrive at this conclusion we have assumed 
that (a) both the score of the umpire and the individual score of the player increase by unit steps 
from zero origin ; (b) constants A, and A, are each equal to unity in the definitive equation 


Xa = Ay. Xu + Ay. а.о 
We shall remove these restrictions by postulating that 


(a) the constants A, and A, may have any value ; 
(b) the increments Ax, and Ax,., may have any constant value ; 
(с) the origin of the distributions of х, and xa. o may have any value m, and me respectively. 
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To make use of the foregoing schema, we then label the frequency of the player's individual 
score as а, when its value is m, and a, when its value is (m, +c. Ax,.,). Similarly, u, is the 
frequency of a U-score equal to (m, +r. Ax,). In this symbolism a cell frequency u, . a, is 
that of a player's total score : 

Ат, + т. Ах) + Am, + c. Axa. 0). 


For brevity, we may write 


Kar = Alyn. Ax) А.т . 0.  « 0. (xd) 
Thus the cell frequency u, . a, defines a total player's score equivalent to 
7-6 ПР S. АҮ. C ET TER * 3 . (xxii) 
The mean A-score for a fixed value of the umpire's score (x, = 7) is then 
ome t=: c=z 
Mc om mr dpa bm 
e-Ü e=0 e=0 
emt c=: 
E A a БА ANS >. а.с; 
e-0 e=0 
МК EU. Ame. m de o. аа 0r s 1 (аш) 
e-0 


When the origins of both distributions are zero we may write for the mean of the player's 
individual score M,., as elsewhere. Otherwise, the symbol is ambiguous. Here we shall 
write it as Mo, so that 


LR EE 
M, = У a(m, + c. Ax,.,) = m, + Ах,., У ae. C 
e=0 e=0 


By substitution in (xxiii) we now have 
M,.,— К... + Ay» M, — A,. m, 
Whence from (xxi) above 
M,.,— Au : Mm, + 4,. M, + Ay. Axu. r = : . (xxiv) 


In this expression every term exceptr is a constant of the distribution involved ; and M,., 
the mean value of the player's total score for a fixed value (x, = r) of the umpire's score is a 
linear function of r. 


The Redundant Umpire 


We shall later see that the umpire bonus model embodies the statistical postulates of the statistical 
technique known as factor analysis. In terms of our model, factor analysis seeks an answer to 
questions of two kinds : (2) how many umpires must we invoke to explain the inter-correlations 
of the scores of a team of players; (b) what is the proportionate contribution of each umpire 
to the variance of the distribution of the scores of each player? Here we may foreshadow an 
answer to (a), leaving the discussion of its practical importance till later. 

From a factual point of view there is a clear-cut distinction between a set-up involving the 
contribution of 2 umpires (U and W) and one which involves a single umpire (Z) ; but the two 
situations may be algebraically identical, as is easy to see when: (a) the umpires U and W 
respectively toss the same die и and w times ; (b) each player adds the actual score of each 
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umpire to his individual score, so that А, = 1 = B,, etc. and A, = 1 = B,. In these cir- 
cumstances we may denote the mean and variance of the unit sample distribution of the die 
of the umpires respectively by M, and by V, so that M, — u.M,; V,=u.V, and 
M, =w.M,; Vo= w . V, whence 
M, + М, =(u+w)M, and У, + Vo= (u + wV, 
The covariance of the joint distribution of the players is therefore the same as if a single umpire 
Z tossed the same die z = (u + w) times, since then 
V, = я. V, = Соо (Xa, хь) = (и + $)V, = V, + V». 
Let us now remove the restrictions imposed above w.r.t. the nature of the dice and the equal 


allocation of the bonuses. For simplicity, we may take the origin of all score distributions as 
the mean, so that replacement implies that 


А.Х, + А.Х, + А„Х„.„ = Xa = А.Х, + AoXa. 0 S . (my) 
В.Х, + В.Х, + B,X,., = X, = BX, + В„Х,.,. . e (xxvi) 
For such a system we may write 
АУ, + А0. + АУ... = Va AIV, + АУ. 
BEV. + ВЬЎ„ + ВУ. = Vy = BEV, + ВФЙ›.„ 
s АУ, + АЗУ, = АУ, and ВУ, + BIVQ— BW. . ‚ (xxvii) 
A,B,V, + A,B,V, = Cov (xa, хь) = ABV; 5 . (xxviii) 


Let us now write 

AV o = KAV u; BEV o = КВУ, ; А„В„Ў„ = KavAuBuVy - 0. (xxix) 
From (xxvii) we then have 

А1 + К.У, = АУ, and В1 + КЫР, = В?У,, 
s АУП К.) = А, and Bov F К) = Bo, .  . (xx) 
5 ABV, = ABV u КО + Ky). 
Also from (xxviii) and (xxix) 
4,B,V, = A,B,V.(1 + Ka). 


Hence the condition of replaceability of the two umpires by one umpire without affecting the 
intercorrelation of the players’ score distribution is 


(1 + Ka)? = (1 + K,)(1 + Ку). 
This must be an identity if K, = Ka» = K», in which case (xxix) implies that 


Е CE EE 


Thus we may say that one umpire Z can replace the two umpires U and W if the multiples 
of the two umpires’ scores respectively allocated to player A and player B are in the same ratio. 
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When this is so (xxx) and (xxxi) imply that 


4, de va FE); B, = ут F Ka), 


EXERCISE 12.01 
1. Аз in Example 1 above, umpire U tosses an ordinary cubical die once. Umpire W tosses one 
coin twice (scoring heads as 1 and tails as 0). Player A tosses the tetrahedral die of Fig. 70 (scores 1, 
2, 3 in the ratio 1:2:1). Player B tosses once the tetrahedral die of Fig. 73 (scores 1 and 2 in the ratio 
1:3). The final score of A is twice his individual score added to 3 times the score of umpire U and 
four times the score of umpire W. The final score of B is three times his individual score together 
with twice that of umpire U and five times that of umpire W, i.e. 


Xa = Зх H 4х, + 2х„,„ and хь = 2x,-d-5x,-d- Зь. о 
Check the following results : 
M, = 185; „= 3625; M, = 1725; V, = 258542; 
Cov (xa, xy) = 27:5 ; ға = 0:898. 


2. Asin Example 2 umpire U tosses a cubical die once. Player A first tosses the circular die 
of Fig. 67 twice, and then tosses once the die of Fig. 70, counting as his individual score four times 
the result obtained with the circular die added to the result of tossing the tetrahedral die. Player B 
tosses the die of Fig. 73 once, and adds to five times his score the result of tossing a coin twice, the sum 
being the individual score. "The final score of A is three times that of the umpire added to his individual 
score. B adds to his individual score twice that of the umpire, i.e. 


Xa = Зх, + 4x, + Xas and ху == 2x, + 5хь, + Aree 
Check the following : 
M, = 24-5; V,— 3475; M, = 1675; V, = 1685; 
Cov (xq, x) = 175; тау = 0:74. 


3. For Example 1 determine the variances of the score distributions of both umpires and express 
their relationship to the covariance of the score distributions of the two players. 


4. Show that the variance (V, . „) of the player's score distribution is the same for all values of the 
umpire's score when the definitive equation is x, = 4x, + Aoa . „ without restriction on the origin or 
scale of the distribution of either component. 


5. Check the formulae for partial correlation given in Chapter 9 by withholding first the bonus 
of one umpire, then the bonus of the other. 


6. Examine the effect on the set-up of Example 2 on the covariance of the score distribution of 
the players and of the value of the correlation coefficient, if 
(i) Player A tosses only the die of Fig. 70 and player B tosses only the die of Fig. 73. 
(ii) Player A tosses only the die of Fig. 67 and player B tosses only the die of Fig. 73. 
(iii) Player A tosses only the die of Fig. 70 and player B tosses only the coin. 
(iv) Player A tosses only the die of Fig. 67 and player B tosses only the coin. 
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Compare the results with those of Example 2 with special reference to the variances of the score dis- 
tributions of the players, and interpret them. 


7. An umpire tosses a coin three times scoring heads as successes. Player A takes three cards 
with replacement from a full pack counting the number of hearts as his individual score. Player B 
tosses a cubical die once. Player 4 records as his final score the result of deducting three times the score 
of the umpire from twice his individual score. Player B adds to his individual score twice that of the 
umpire. Investigate the joint distribution of the scores of the two players and that of each player with 
that of the umpire. 


NON-REPLACEMENT MODEL 
from a full pack 


Initio! 3-fod 90 
draw of Player A 


Fic. 91. A Non-replacement Model. Player A takes 3 cards from a full pack without replacement and player B 
then takes 2, each recording as his or her score the number of hearts in the sample. 


12.02 THE NoN-REPLACEMENT MODEL 


Whether we score by the taxonomic or by the representative method distinguished in 7.01 of Vol. I, 
the withdrawal of a sample without replacement limits the possible score value of a sample drawn 
subsequently from the same universe. If one player takes a sample containing all the highest 
cards, a second player must evidently have a lower mean score than otherwise. Hence there 
will be a negative correlation between the players’ scores. Correlation of this sort is the theme 
of the models whose properties we shall now explore. A numerical example involving the 
taxonomic method of scoring will clarify our task : 
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Example.—From a 6-card pack consisting of 2 clubs and 4 hearts, the first player (A) simultaneously 
draws two cards and the second player (B) draws three from the residual pack of four. A’s heart 
score (0, 1 or 2) distribution is given by successive terms of (2 + 4)9/609, viz. 


A'sscoe . е . mu cd 2 
Frequency (x 15) . » d 8 6 
"The residual packs from which B draws are as follows : 
A’sheart score . . | 1 2 
Residual : 
hearts . Р ; . 4 3 2 
clubs . b P T 4 2 


If A's heart score is 0, that of В is necessarily 3 for the 3-fold draw. If A’s heart score is 1, the dis- 
tribution of B's heart score of 0, 1, 2 or З accords with the terms of (1 + 3)(9/49), If A’s heart score 
is 2, the appropriate binomial is (2 + 2)/4@. Thus we get a frequency table : 


B's heart score 
when x, = 0 " 


X,—1 З * . . 
N72 " . . . 0 


ooo 


w OO = 
sH ев O N 
Ommu 


To obtain the correlation grid we have to weight the above by corresponding frequencies of A’s score, 
and obtain 


B 


[ 


A 


Mean 


From the above we obtain 
V, = 16/45; V, = 2/5; 
Rog = — 3/4; ka = — 2/3; 
Cov (Xar хь) = — 4/15 = ly, V, = RaVy; 
Ta = — 1/V2. 
We shall later see that 7, depends only on the sampling fractions defined by n.f, = a and 
n. fy = b, and is in fact (f,-f,)/(1 — fa)(1 — fo) = ra. In the above example, 
fa = 216 = $; „= 3/6 = +; 
ce (Sa fr — f — fo) = $= ть 


The Two-class Universe 


When we employ the taxonomic method of scoring as in the foregoing example, we may make 
use of relations we have already obtained in Chapter 3 of Vol. I. For illustrative purposes we 
assume that 4 and B each records the number (x, or x;) of hearts in the sample, the proportion 


a 
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of hearts in the full pack being p = (1 — q). For an r-fold non-replacement sample, we have 
obtained the mean and variance of the score distribution on pp. 102 and 138 of Vol. I, viz. 


n—r 
M,=rp and И 4 - . 


0 


If А had already drawn a cards of which x, are hearts from the pack containing np hearts in all, 
the universe from which B draws a b-fold sample contains (n — a) cards of which (np — xz) 


are hearts, so that the mean score of B for a fixed score x, of player A is given by 


b 
Mu = Ep. den) = ———(np — ж), 
bn, А 
"Mac a сузы 
b 
= ———(ap — x), 
b 
Mya — M, = — = = — Mi). 


Thus regression of x, on x, is linear, and by analogous reasoning the converse is true. 


of x, on x, we may write the regression coefficient as 


b 
fcc n—a 
From (i) we have 
(n — а) 
Kerr en 
Since regression is linear we may obtain the covariance directly from the relation 
— ab 
Cov (s #1) = ®ы. Va = — P9 - 


Alternatively, we have 
Cov (Xa, ху) = E(x,, xy) — М.М, = E.(x,. Moa) — abp*. 
In this expression 


ыма Ь.җ(пр—х) _ тр.» ,b.x; 


n—a n—a CET 
-M, b 
е Eel. My.) = TP LL Et) 
2 b 
= i Vue Mh 


(ii) 
For that 


(iii) 


(iv) 


(v) 
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Whence as above 
Cov (xa, хь) = =a 
Tied cem 124 
To obtain an expression for ғ,» we need to evaluate Из. If we denote the variance of the distri- 
bution of an (a + Б) fold sample score (x, + x») as Va» 
Vazo = Va + V + 2 Соо (xa, хь). 


From (i) above 
— a — by(a + b 
Vas = rimi i Coli =< X )pq. 


Whence we have 


(иа batb (п дар, abpa 


m n—1 n—1 ‘б п-Т1 
(vi) 
ab = 
os Tay = — is Е Р š : . (vii) 
If we use f, and f, for the sample fractions as above 
RC ER _ T 
oe = = ата 


In particular, when а = b so that f, = F = fy 
mer. 
а= тр 
When F = 4, ra, = — 1, since there is only one sample which B can take for any one sample А 
has already taken. 

From (i) and (vi) we see that the variance of B's score distribution is exactly as it would be 
if A had not previously drawn an a-fold sample. This conclusion is at first surprising, and 
we may arrive at it by an alternative route. In virtue of the fundamental tautology of the grid, 
we have 

„= V(Ms . a) + MV,..;). 7 a 7 с (ix) 


Also, in virtue of linear regression 


FM. eR eR a рд 


~ (n— Yn — a) 
In (ix) we may write 
M(V,.,) = ЕУ. a). 
The variance (V,.,) of B's score distribution for a fixed value of x, is the variance of a b-fold 
sample score distribution from an (л — a) fold universe in which the number of hearts is (np — ха). 
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So we may write 


ўы au ETE, Б) (np x) (n a — np + xa) 


(n—a—1)' n—a n—a 

Gera ч а) 
a b(n — a —b) Hi : 
m cce pray ign cod rgo 


«^ М(Рь. а) & C peti? n*p* — anp + (2np — n + a)x, — х2). 


In this expression E,(42) = V, + M2, whence 
E,[n?p — n*p* — anp + (2np — п + a)x, — x2] = рап — ay — Vn 


b(n — a — b)pg ab(n — a — b)pq 
SE Миа a—1 (аап а 10и 1) 


Whence from (іх) and (x) 


р, b(n — a — b)pq ab(n — a — b)pq ab? pq 
d n—a—l (п — an —a — (n — 1)  (n— a(n — 1) 


Hence in agreement with (vi) : 


СО) 


n—1^^ 


V, 


Representative. Scoring 


We shall now assume that the pack contains no picture cards. Accordingly we may score the 
sample by adding the number of pips on each card, e.g. the score of a 3-fold sample consisting 
of the ace of clubs, the З of spades and the 7 of hearts will be 11. Whether the pack contains 
equal numbers of cards with the same number of pips is immaterial. 

І As before we assume that player A draws a cards from the full pack of n cards without re- 
placement and player B draws b cards without replacement from the residual pack of (n — a) 
cards. We shall denote the total score (score-sum) of player A by s, and that of player B by sp. 
We may assign to each individual card a rank referable to the order in which the player draws it 
if he draws the cards successively, or to their place in a face upwards sequence if drawn simul- 
taneously. We may then label the score of the uth card drawn as x,. The subscript has nothing 
to do with the numerical value of the score, its function being to label the card as a removal, 
ie. one which the residual pack does not contain. By definition, then 


ua u-b 
<= 5 x. and а PE 5 f 6 - (vi) 
“=i ч=а+1 


If we write the second zero moment of the two score distributions as и, and He» the correspond- 
ing variances are 


Va = pn — M; and V, = pn — MÈ . . : fo (xi) 
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Tn these expressions 
M, = E(5q) = Е( + ta + ха... Xa) 
= E(x) + Elm)... + E(x). . . . (хш) 
Haa = E(sq) = E(x, + х. + ха... xa)? 
= Ей) + E(x3) + E(x3) . . . etc. 
+ 2E(x.2x)--2E(.x) ...etc. . É : . (xiv) 


To evaluate M, and js, we must first define E(x,) апа E(2), i.e. the mean value of the unit 
score and of its square regardless of the order of choice. With this end in view, we shall denote 
the score-sum of all the cards in the n-fold pack by S,, and the sum of the squares of all the in- 
dividual card scores as Ssn, so that 


ПЕЙ ч=п 
S,= У x, and На Ува. В 5 : . (xv) 
wel ч=1 
For the corresponding score-sums of all the cards in the residual pack of (m — р + 1) cards 
after extraction of a (p — 1)-fold sample, i.e. immediately before extraction of the pth card, we 
may use $,..,,; and Syn -p+ so that 


Sp-241 = > х, and S44 941) = > x . . . (xvi) 
м=р ump 
Let us now consider the result of two consecutive draws, the pth and the (p + 1)th. Since the 
player takes a card from a residual universe of (n — p + 1) cards at the pth draw we may write 
the mean score drawn as 


E(Sn— 941) 


Ee) Lt. 


The operation E here refers to all possible values p may take but involves no restriction on the 
residual universe other than the fact that it contains the card whose score value is x. Hence 
we may write with equal propriety 


E,(S, . 5 

E(x,) = E(x) = eee A n í p . (xvii) 

If we write 4 = (p + 1), the operation E, . , signifies taking the mean value of the score at the 

gth draw after removing the particular card whose score is x, at the preceding draw, and this is 

equivalent to finding the mean score of a unit sample from a residual pack of (n — p) cards whose 
score sum is S, ,,, — x,. Thus 


Sn-p+1— X, 
O = n 


The mean value of (x;) is the weighted mean of the above for all values of pth draw, i.e. 


ES. s.) Eled 
n 


Бра) = Ep. By. m) = Pans a 
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Whence from (xvii) 
щы) — Eee Eksa) EAS 4s) 
n—p =E= PFE n—pt+l 
`. Еф) = Ex), 
5 E(%y 41) = E(x). 


Thus the mean value of the card drawn is independent of choice and therefore E(x,) = E(x). 
If we denote the mean value of the first card drawn from the full pack as M, = E(x;), we there- 
fore have 


M, = E(m) + Е(хз) + . . . E(x.) = aM, . . ғ . (xviii) 
Similarly, M, = b. M,. If we substitute a2, 32, and San-p+n for x», Xa and S,_»,; in the 


p Yp 
foregoing argument and write E(x?) = pa, we derive in the same way 


E(x) = m=% . soc 057 3 ERI 


To complete the evaluation of V, and V, we also need to determine the mean value of 
the product terms in (xiv) above. If we write x, . x, as the product of any two unit scores of 
the sample, its mean value is the weighted mean of the product of x, and the mean value of x, 
for the same fixed value of x,, i.e. in the symbolism of 11.01-11.04 : 


E(x, . хь) = Е... Е„.„(хь)]. 


To interpret the meaning of the operation E,., we recall that the only restriction implicit is 
that the residual universe does not contain x,, and we have already seen that the mean value of 
x, does not depend on order of choice. Hence E, ., means taking the mean value of x, from 
a pack which does not contain x,, i.e. from an (n — 1)-fold residual universe of which the score- 
sum is (5, — Xu), so that 


S,— x, 
E, ale) = 2—*. 
In this expression 5, = nM,, so that 
n a 
Ev (x9) = 17 m са) 
x 
to Rye Lesa te) = №: -Xu — TAN 


ne E(u u) = =M E (x) — E 
Whence from (xix) 


n 1 

Eu» ха) = с=т aa а . ;  ) 
'Thus the mean value of the cross products in (xiv) is independent of the order of choice. 
In (xiv) the number of terms is a, of which a have the form х and a(a — 1) have the form 
Xu» Xw, the former being the diagonal terms when we lay out the operation of squaring grid- 
wise, eg. : 
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x ха E E 
x x хуха хуху хуц 
Xs ЕАД a3 хаха хаха 


Xa XXi XsXs x» хх, 
х, XS хаха ху x» 


Thus we may write (xiv) in the form 


Hog = а. E(x2) + a(a — 1) E(x, . xv) 


—1 —1 
= ay, + OD му L0 
. a(n — a) na(a — 1) 
сар к аа Mi, 


ED BOE), А nean aM}, 


n—1'*' n—1 
sy, 9M. CENE ы) 


At every step in the foregoing argument, we have shown that E(x,), E(x2), E(x,, x.) do not 
depend on the order of choice, hence the form of M, and V, is analogous, i.e. 


Mabie aid И = = Кем i ‚ бой) 
The value of Cov (Sa, s,) is deducible from (xx) since 
Cov (Sas $2) = E(sa, з) — М.М, = E(s,, зу) — ab. Mi; 
E(Sqy S) = Ё(х + х + Xs... xo) (X43 + Masa + - - X9]. 
In the expansion of the last product there are ab terms, i.e. 
E(s,, =) = abE(x, . x) 
E E 1,5 E ye ` 
^. Coo (so 8) = ME „уь 
rn л И у V туи (Әй) 
@—a) 
b V, 


IU ETE ГА Е 5 Y X . (xxiv) 
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From (xxii) above we see that 


__ b(n — b) 
= and) 
Vab 


+ Tan = (xxv) 


UM (n — ап — b) 
If we denote the sampling fractions by f, and f, as above (i.e. a = nf, and b = nfs), 


Em | 
ES E 
We may arrive at (xxiii) by an alternative route. If a is fixed we have 


Mya = Ep. (9%) = Ep. d Xas1- Xo42- ++ хь) = b. Ey. (xu). 


In this expression E, „(х,) is the mean value of a 5-fold score-sum from an (n — a)-fold universe 
of which the score-sum is (S, — $1), so that 


b nb b 
Mya = 2—08, 3) = LM ы 
nb b 
M,.,— M, = — Sa — b. Ms, 
M, M, = 2 М, ii 
* Mya — ye e "EE с » В . (xxvii) 


There is therefore linear regression of s, on sa, and (by the same reasoning) of sa on s» and 
the regression coefficient in (xxvii) is 


In virtue of linear regression, we may write 
Cov (Sas $5) = Roa» Vas 
b 


n—a™ 


=. Cov (Sas $) = — Ж 


The reader will note that (viii) and (xxvi) are identical expressions. Also the appropriate 
expression for V, or V, reduces to that of the hypergeometric distribution for the 2-class case 
since we may write the variance of the unit sample distribution in the form 


V, = ра — М i 
For the 2-class universe V, = pq and (xxi) reduces to 
a(n — a 
У. = : pa. 


n—1 


Numerical Example.—From a pack of six cards consisting of the ace, 2, 3, 4, 5 and 6 of clubs, each 
player takes two cards without replacement, recording as his score the total number of pips. Since A 
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draws twice, he may select any one of °C, = 15 combinations, and В may choose any one of *C, = 6 
residual combinations which we set out in the following schema : 


A's. choice Possible choice of B 
12 34 35 36 45 46 56 
13 24 25 26 45 46 56 
14 23 25 26 3 36 56 
15 23 24 26 34 36 46 
16 23 24 2 34 35 45 
23 14 15 16 45 46 56 
24 13 15 6 35 36 56 
25 13 14 16 34 36 46 
26 з 4 15 34 35 45 
34 12 15 16 25 26 56 
35 12 14 16 24 26 46 
36 12 14 15 24 25 45 
45 12 13 16 23 26 36 
46 12 13 15 23 25 35 
56 12 318 14 з 24 43 


The corresponding scores of the samples set out in the foregoing schema are as follows : 


re са. Possible B-scores 
12 3 7 8 9 9 10 11 
13 4 < 8 9 юп 
14 5 SF v8. 8 Do п 
15 6 66 а 7 9 10 
16 7 Le a 7 8 9 
23 5 Seo. eos) a9 10. и 
24 6 4 6 7 8 9 11 
25 7 4 5 7 7 9 10 
26 8 4 5 6 7 8 9 
34 7 3 6 7 7 8 11 
35 8 AT ЖДД. 8 10 
36 9 $ «5 «6% 6 7 9 
45 9 3 4 7 5 8 9 
46 10 3 4 6 5 7 8 
56 1 З A 6 7 


Each of the 2-fold samples either А or B сап draw admits of two permutations. So the number 
of permutations corresponding to particular scores in this lay-out are in the same ratio as the number 
of combinations. Consequently, the required frequencies of particular A-scores associated with par- 
ticular B-scores are as exhibited above : and we may summarise the result as a correlation table in which 
the drift of figures is downwards from the top right-hand corner to the left lower corner : 
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A 
з 4 5 d) TR gu Ig HO aT "Total Mean Variance 
3 sob! em M Eve „ы 1 1 2 1 1 6 90 2 
4 YR T. deed 1 1 1 1 1 1 6 85 н 
5 А 2 1 2 2 y 1 2 12 80 4 
6 1 1 2 2 2 2 1 1 12 75 н 
7 1 1 2 ГО ДИҢ} 2 1 1 18 70 н 
ii 8 1 1 2 2 2 2 1 1 $e 12 65 н 
9 2 1 ЖЫ о E 1 re Ren 12 6-0 4 
10 1 1 1 1 1 1 6 55 н 
11 1 1 2 1 1 6 50 2 
"Total 6 6 12 12 18 12 12 6 6 90 7 ag 
Men| 90 85 80 75 70 65 60 55 50 7 — — 
Variance] 2 Ho 4 d dH H 4 H oV EE = = 


From the data contained in the correlation table we obtain 

Cov (x, хь) = — $; = M = Vy; 

*. Tay — d. 
For the inter-class and intra-class variances we have 
ИМ) = $ = V(My); 
M(Va) = $ = M(V ra) ; 
V(M,) + M(Va) = 3 = Vas 
V(Mya) + M(Vy) = 5 = Voi 
^ V(Moa)|Vo = ViMar) [Va = 1 = rh 

The sampling fractions are f, = 3 = fo, 

faf) — fo) = 4 = ть 
Partition of Variance 
Some current text-books suggest to the readers that the square of the product-moment co- 
efficient is a just measure of explained variation. We have seen that this is true of correlation in 
the consequential domain of the Umpire Bonus set-up, and regression is always then linear. 
In the concurrent domain the square of the product moment coefficient is not a true measure of 
explained variation, though regression may in fact be linear. Regression is linear in both dimen- 
sions of the non-replacement model ; but no meaningful partition of variance is possible. There 
is a negative correlation between the score of player B and the antecedent score of player А; 
but the variance of the B-score distribution is exactly the same as it would be if A had not drawn 
asample. Evidently, therefore, the square of the product-moment coefficient is not a measure of 
how much the circumstance of A’s antecedent choice contributes to the total variance of the dis- 
tribution of the B-score. 
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EXERCISE 12.02 


Set up the correlation table for the long run result and evaluate M,, My, V(My . a), M(V, . a), V(M, . d) 
M(Va . у), Roas Ray and Tas for the following situations. In Examples 4-8 each player adds the umpire's 
score to his independent score. 


1. A pack consists of 10 cards numbered 1 to 10. A takes 3 without replacement and retains them. 
B takes 4 simultaneously, the players recording their total scores by adding the denominations of the 
cards. 


2. Another pack containing hearts only consists of 6 aces, 3 twos, 4 threes and 2 fives. Player A 
takes 4 without replacement, retaining them. Player B takes 3. 


8. An urn contains 15 balls of which 5 are red and 10 are black. The players draw without 
replacement, A taking 2, B taking 5. They count as their scores the total number of red balls in the 
sample. 


4. A pack consists of 4 cards numbered 1 to 4. The umpire takes 2 without replacement. After 
noting his score he returns the cards to the pack. The cards are then shuffled, the top two are given 
to A and the other two to B. 


5. The situation develops as in 4. After return of the umpire's cards to the pack, A takes one 
card and retains it, then B draws two, without replacement. 


6. A pack consists of six cards numbered 1 to 6. The umpire draws two without replacement 
and retains them. A then takes two from the remainder and B gets the two that are left. Does reversing 
the order of taking the cards make any difference ? 


7. А pack consists of 9 cards, numbered 1 to 9. The umpire takes 2, without replacement and 
retains them. A draws 2, without replacement, from the remaining 7, after noting down his score he 
returns them to the pack. B now takes 2 without replacement. 


8. Four black and 2 white balls are placed in an urn. The umpire draws out 2 simultaneously, 
scoring the number of black balls. He replaces them in the urn. A now draws 2 simultaneously 
and retains them. B draws 3 simultaneously from the remainder. 


12.03 Tue Two-pack MODEL 


We shall now examine a model situation, which involves correlation with linear regression in 
both dimensions, as in the foregoing section. As is true of the non-replacement model, the 
causal nexus is not a concurrent relationship like that of the two players of the Umpire Bonus 
set-up. Nor is the type of reciprocal constraint of a sort which we can rightly describe as 
consequential in the sense that the score of the player in 12.01 is consequential to that of the 
umpire. 

We suppose that two players extract samples with replacement, one from a full card pack 
and one from an otherwise identical pack containing no hearts. Player A takes a cards from the 
full pack and records his heart score (x,). Player B takes (a — x,) cards from the pack which 
contains no hearts and records as his score (хь) the number of diamonds in the sample. We may 
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denote the numbers of cards in the n-fold pack from which A draws as follows : 
Hearts Diamonds Others 
пр. np, пр, 
Evidently (np, + mp, + np.) = n and (pa + Po + Р.) = 1. 
THE TWO-PACK MODEL 


Diamond Score of B for а 
(3-hMold draw with replocement 


B SCORE 


o ! 2 3 
охо | Ox! Ох2 | Ox3 

хо Ix] 1х2 
ЕЕЕ 


о 


ш | 
ў 2*0 2х1 
* 2130700) | sura 


3*0 
e 


(a) 
Heart Score (h) of *e 

Player А for а 3-ЮФ? 
drow with replacement — 9, 
from full pack. [] 


Fic. 92. The Two-Pack Model. Player A takes 3 cards from one full pack replacing each before drawing another, 

and recording as his score the number of hearts in the sample, Player B takes a sample from an otherwise full pack 

after discarding all hearts, the size of sample being 3, 2, 1 or 0 according as A scores h = 0, 1, 2 or 3. The score of 
player B is the number of diamonds іп the (3-h) fold sample. 


In B’s pack there are (n — npa) cards of which np, are diamonds. Thus the proportion of 
diamonds in B's pack is рь + (1 — pa), whence 


2. 1-Р. i 
M, = as and V,.,— (a X ( 155). i © 


Evidently, M, = apa, and V, = apa(1 — р). Since E,(M;..) = My, 
ap, PvE (Xa) ap, М,.рь 
Т= m dc 
^ Mya My = ү= = cou)... a ey 


— Pa 


м, 
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"Thus regression of x; on x, is linear, the regression coefficient being 


"The variance of B's score for a fixed value of x, is 
баа) — p. — bs) 
(1 — pa)? 


Vo-0 


^ M) = 


fmm e : 
г. Сою (ха, xy) = Е. Va = — а.рь.фрь 
Since regression is linear we may write 


V(M,..)— Ka- Va = 


а.р„.% 


1— pa 


april — Pa — P») Proll — Pa — Pr) - apa 


_ Pl — pa — Po) 


We thus derive 


V, = V(M,.;) + MVi.,) = 


а 
Hence we have 


(1 — Pa)? 


(1 — pa) 


ap(1 — pr) 


с / Papo 
(1 — pa)(1 — po) 


Example.—A draws З cards from a full pack, scoring hearts as success. B draws (3 — Л) cards 
from a 39-card pack containing 13 diamonds and scores diamonds as success. 


арар} 
1 


(1 — pa)? 


ER 


api(l — pa — b) 
1— р, 


0 1 2 3 "Total Mean Variance 
А Жый. 6. 27 1 H 
1414 de^ 7 27 H + 
CS E v8: ТОО 9 à $ 
3| 1 о 0 0 1 0 $ 
Taal Ж 27 э л 64 2 E 
Men| 1 4 4 0 4 
Variance | $ $ $ $ Ys 
М,=%= М; У, = = Р; 
Cov (xa, хь) = 165 — 65 koa = — $= Rs 


М(Уь. a) = 3— М(У,.ь); V(M a) = 3s = V(M,.)); 
V(M,. ;)|Vy = $ = V(M, .ь)/Ў,. 
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(vi) 


(vii) 
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EXERCISE 12.03 
Investigate the following model situations and construct a grid like that of Fig. 92 for each. 


1. Player A takes 2 cards with replacement from a full pack recording as his score the total number 
(s) of spades. B takes (2 — s) cards with replacement from a 39-card pack containing no spades, but 
otherwise complete, and scores diamonds as successes. 


9. Player A takes with replacement 3 balls from an urn containing 5 red ones, 7 black and 13 white, 
recording as his score the number (r) of red balls in the sample. Player B takes (3-7) balls with re- 
placement from an urn containing only 5 red and 7 black, again scoring red balls. 


3. What would be the result if the players of Example 2 did not replace ? 
THE RECTANGULAR UNIT SAMPLE MODEL 


Size of Pack(x,) | 2 


Expected Score (x,) 
of Unit Sample 


ic 
2 Ц 


Fic. 93. Rectangular Unit Sample Model. The player takes one from each of 6 packs respectively containing 1,2, 
3... 6 cards, all clubs numbered consecutively from 1. "The marginal entries respectively show size of pack and 
the player’s expectation. 
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12.04 Тнк Unit SaMPLE RECTANGULAR MODEL 


The two preceding models illustrated situations in which correlation goes with linear regression 
in both dimensions, though we cannot properly regard the law of association as linear in any other 
sense. We shall now examine a situation in which correlation goes with linear regression in 
only one dimension. The rule of the game is as follows : the player chooses one card from each 
of a set of packs containing different numbers of cards consecutively numbered 1, 2, 3 . . . etc., 
and records as his score the number on the card chosen. In each numerical illustration cited 
below, the player takes one card from a set of card packs containing 1, 2, 3, up to 6 cards of the 
club suit starting with the ace. Thus the smallest pack consists of an ace only, the 2-fold pack 
of the ace and 2, the largest pack containing the ace, 2, 3, 4, 5 and 6 of clubs. The score x, 
is the number of cards per pack, the player’s score being x, clubs in the unit trial from any par- 
ticular pack. The maximum score (N) of the player is therefore 6. 


Example 1.—There are 6 packs in all, so that the player takes 1 card from each pack in a single 
set of trials. Thus the A-score distribution is rectangular like that of x, within a column. 


No. of cards per pack (x,) 


1 2 3 4 5 6 "Total 
40 30 24 20 294 
40 30 24 20 174 
40 30 24 20 114 
— 30 24 20 74 
= — 24 20 44 
-— — — 20 20 
120 120 120 120 720 
20 25 3-0 35 2-25 
4 П 2.0 н 3-5 


M,—35; ka=}; My= 225; V, — id; 
V(M,.;) = 4$: M(Vi.;) = #4; Vy = d$ = V(M, . a) + MCV n a); 
Kj. Va = її = V(Mi. а); Вы. Va = $$ = Cov (x, хь); 


Example 2.—А set of unit trials involves choice of 1 card from each of 243 packs, the A-score 
distribution being defined by successive terms of the binomial (3 + 4)’, i.e. the set-up is 


No. of cards per pack wl 2 3 4 5 6 


No.ofpacks . З ЕЗ2. a O O l 1 
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No. of cards per pack (x4) 


1 2 3 4 5 6 "Total 
1 192 240 160 60 12 1 665 

2 — 240 160 60 12 1 473 | 
Players 3| — = 160 60 12 1 233 
score 4 — — — 60 12 1 73 
(xs) 5 12 1 13 
6 1 1 
Total | 192 480 480 240 60 6 1458 
Mean 1 15 20 25 30 35 En 

| 


Models of this class are not without relevance to practical affairs, since they illustrate the genesis 
of a coefficient of correlation possibly serviceable as a summarising index of the influence of birth 
order on the incidence of rare congenital conditions if they occur singly in a sibship. If parity 
has no effect on the long run expectation w.r.t. birth rank of affected individuals in a sibship s 
members will be equal for rank 1,2 . . . s. A grid lay-out with family size as one set of border 
scores and birth rank of affected individuals as the alternate set will then exhibit a triangular 
contour; and the birth rank mean will increase by equal steps w.r.t. equally spaced family size. 
On the same assumption there will be a correlation between the two sets of scores; and the 
product-moment coefficient must be less than unity. ‘To the extent that affected individuals crop 
up mostly among first births or towards the end of the family, the observed value of the coefficient 
will approach zero or unity respectively. ‘Thus the discrepancy between the value of the product- 
moment coefficient (r,) computed from observed data and its value (r,;) computed in accordance 
with the null hypothesis of equal expectation is indicative of the extent to which birth rank 
influences the occurrence. If r, is product-moment coefficient for the observed bivariate distri- 
bution of affected individuals to each of which we assign one score (x,) in virtue of family size 
and one score (хь) in virtue of birth rank, and r,, is the corresponding coefficient computed on 
the assumption that the expected birth rank of the individual has a rectangular distribution 
as in models of this class we may define an index (B,) which has the value zero when there is 
no birth rank effect with limits of + 1 and — 1 respectively, signifying that all effects are last- 
born or first-born, viz. : 


(To — Tas\(2Fo - Tas — To — Far + 1) 
Tall — ra) 2 

For this class of models, we have already defined the score x, as the number of cards in one 

of a set of packs from each of which the player selects a single card. He records the number of 


pips as his own score x, referable to a particular pack the cards of which have 1,2, 3 . . . pips 
up to s, the size of the pack. No more than one card of a particular denomination is present in 


B, 
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the pack, and the denominations are consecutive, hence the unit sample distribution with re- 
spect to any pack is rectangular. In the biological illustration x, and x, respectively correspond 
to family size and birth rank. The mean value of x, associated with x, is evidently 4(х + 1), 
so that 
M, = 4E (x, + 1) = М, + 1), 
2. М... — My = Ms — Ma). 
Thus regression is necessarily linear in the B-dimension of the grid, irrespective of the distribu- 
tion of card pack size and kj, = }. In virtue of linear regression 


Kia» Va = V(Ms. a), 
^ ИМ.) = WV e 
From the elementary property of the rectangular distribution, 


Wee s 
EN oo sse 
P “++ 
ll NECS 
rs os з-с 0 


The evaluation of 7,» now depends solely on the distribution of card pack—in our biological 
illustration family size (x,). ‘Two cases admit of easy solution : 


(a) rectangular distribution of family size from 1 to N as in our first numerical example : 


N+1 2 (NS. N—1. 
М, = 2 ; Mi ur Ve D 
T SED) 2 
^79 —T7NGd C C G 5 = . (iv) 


(Б) binomial distribution of family size as in our second numerical example. Ме assume 
that consecutive values of x, from 1 to N occur with frequencies defined by successive 
terms of the binomial (q + 5)" - !, so that 

M,—(N—Y1p--1 and V,—(N— Dpg, 
N—1 
«Ye Ege + (у — 5р 
3q 
намеда. tiem ee 
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The variance of the player’s score in the unit sample rectangular model set-up admits of 
a unique partition in terms of the contribution attributable to the circumstance that the card 
packs are of unequal size in a set of trials only if we agree on a quite arbitrary prescription of how 
we propose to eliminate the source of variation. The problem admits of a simple solution if our 
prescription is to replace each individual card pack of a set of unit trials by one and the same pack 
of M, cards, as is possible only if M, is an integer. For the residual (unexplained) variance V, 
when we eliminate in this way the source of variation arising from the fact that the card packs 
are not all of the same size we may then write 
‚ M;—1 
p B 


Hence from (ii) above, since V(M,.,) = 1V,: 


ATUM ze 
У = 3 +V, = gV Ma) + Vi. 


It is however arguable that we might pool the N packs of variable size in each N-fold set of trials 
and record the result of taking N unit samples with replacement from the composite pack. Such 
a procedure admits of no singular solution unless we specify the distribution of card pack size, 
and hence of the unit sample distribution of the composite pack. 


EXERCISE 12.04 


Examine the joint distribution of the player's score at a single trial and the number of cards in the pack 
each consisting of cards consecutively numbered from 3 upwards when the distribution of the packs 
are as follows : 


Size of Pack 1 2 3 4 5 


No. of Packs 
(a) ат n AR 
(5) 1 4 5 
(c) Ое Е УУ 


12.05 Lexis MODELS 


The rule of the following model, so named for reasons mentioned in Chapter 9 of Vol. I, is that 
the player draws the same number (s) of balls from each of w urns, each containing л balls of which 
a certain number (x,) are red, the player's score (хь) at a given trial being the number of red 
balls in the s-fold sample. Within this framework, we may distinguish two solutions according 
as the player does or does not replace before drawing another ball. When there is replacement 
the sample distribution is given by the terms of the binomial 


(n — x, + Xa) + n. 
When there is no replacement the definitive binomial is, of course, 


(n — x, + х.) = п". 
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3-fold Draw from 
A STRATIFIED (LEXIAN) UNIVERSE 
өөө 090 090 ӨФӨ v, (Mas Ma Мь Eg Mo 


о 
а иш d$ & ko 8 


E 
ере вва 
ep = 


$oa B 
TEREE 
i 


& 
"en & & à 8 4 


oie 
BN 


Weighted Tu: 5 5 — $$ 


Ma VM) MM) №" 
[V Mpo) MM] 
Fic. 94. Correlation in a Lexian Universe. The player draws with replacement 3 balls from each of 4 urns, 


respectively containing red : black in the ratios 4: 1, 8:2, 3:2 and 2:3. ‘The player's score is the number of black 
balls in the sample. The urn score is the number of black in every 5 balls in the urn. 


Example 1.—Six urns each contain 5 balls of which 0, 1, 2... 5 are respectively red. The 
player takes 3 balls with replacement from each urn. 


per urn (xa) 

Red balls 0 1 E 3 4 5 Total Me.» Vect 
0| 125 64 27 8 1 [] 225 HE iun 
prol 0 48 54 36 12 0 150 ni HM 

sample 

(xp) 2 0 12 36 54 48 0 150 tH Hi 
3 0 1 8 27 64 125 225 8t a 

"Total 125 125 125 125 125 125 750 i i 

Ms. a 0 Ц $ Ы № 3 Ы =: = 

Vy.s 0 i E ii H 0 E = Fi 
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3-fold Draw from 
THE PARENT HOMOGENEOUS (BERNOULLIAN) UNIVERSE 


600 ӨФӨ ӨӨӨ ӨФӨ М. ww Wo tx 


е и & & T? oo RUN 

E NL NL EL 

E B в ж $ 

E E à & P$ 0 EM 
$ 


o ИЕ 


o 
de 
os 


DODD 


Ma УМ МӘ М- 
Мммм) 


Fic. 95. Homogeneous sampling from 4 urns each equivalent to the pooled contents of the urns in Fig. 94. 


M,—i;h—i;M-i 


717703 66668 


VM.) = cara? MU 9) = areas! 


V(M,..) = 855 MV». —$; V; = 80; 
Cov (Xa) хь) =F = Вы. Va; 
su +1) 


35. 
„= 18; 


ri 21 n 
V, a 739^ (s — yu + 1) + 309 — и + 1) 
Example 2.—Six urns each contain 5 balls of which 0, 1, 2... 5 are respectively red. The 


player may choose without replacement 3 balls from each urn. 
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per urn (xa) 

Red balls 0 1 2 3 E 5 Tou Ma.» Vaso 
1 0 0 0 15 H + 
6 3 0 0 15 H E 

3 6 6 0 15 ag + 
0 1 4 10 15 м + 
10 10 10 10 60 + н 
+ Li ka 3 ł = = 
v 0 E = =- 


M, = $3 ka= &; M, = f; ka = $i 
V(M, . 3) = $$; M(Va . 0) = $8; V(Ma . ») + МУ.) = H = Vo; 
VM.) = $$; MV» a) = 55 VM.) + МР.) = = Р; 
И) pars 0.0, 


Example 3.—The player chooses as in Example 1 3 balls from the same 6 different sorts of urns 
each containing 5 balls, replacing each ball drawn before taking another. "There are however 32 urns 
instead of 6, the x, score distribution being binomial in accordance with the terms of (3 + }4)°, i.e. the 
urns are as follows : 


Cov (xa, хь) = $ = hoa. Vai 


No. of red balls per urn. . EU 1 2 3 4 5 
No. of urns . E " ing 5 10 10 5 1 
per urn (ха) 
Red balls 0 1 2 3 4 5 "Total Ma.» VV 
0 25 64 54 16 1 0 160 i 10 
per 1 0 48 108 72 12 0 240 an iS 
sample 
) 2 0 12 72 108 48 0 240 А Xs 
3 0 1 16 54 64 25 160 ag ES 
"Total 25 125 250 250 125 25 800 — — 
м..| d + 1 TE m = = = 
Р... |00 m m Hn | ou 0 = = = 


V(Ma . y) = $995 M(Va . 0) = 885 VM, . o) + Ma. 0) =F = Vas 
WM, . a) = 35; MVo. a) = $; ИОМ. a) + M, . a) = 33 = Vo; 


ИМ.) s. У, 
y, CIV 3 Mi — My 


тау 


E 
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In all the foregoing, we suppose that there are и urns containing an equal number (л) of 
balls some red, some black, the proportion of red balls in the ath urn being р, and the actual 
number (npa) being the A (column border) score (x4) of the grid. The player draws a sample 
of s balls from each urn (with or without replacement) and records as the B (row border) score 
(хь) the number of red balls in each sample. The symbol M, stands for the mean number of 
balls per urn. With or without replacement, the mean score of an s-fold sample from the ath 
urn is spa, so that 


Xa s s s 
Pa n? М.а SPa PEE M, =F lwo) = =М,; 


s. My. — My = An — иў. e 9 ИЗ 


"Thus regression of the player's score on the A-score is necessarily linear. It is then a property 
of the score-frequency grid, as shown in 11.04 that 


V(M,.,) = V, — M(Vi.,) = В„. Vay 
n VMs.) = у. . teu. S.L n 


It will suffice to develop 72, in accordance with the condition that there is no replacement, since 
the alternative case is deducible therefrom as a limiting condition. If the player draws s balls 
simultaneously from an urn containing x, red balls and b, = (n — xq) black ones, the distribution 
function for the x, score is (x, + b,)' + пе) ; and its variance w.r.t. such an urn is given by 


У.а = e - Ac dee = xe). 


Lb — Pa) = 
Now M(V,.,) = Е (У.а) and 
E, [x(n — х„)] = nM, — E,(x2) 
= nM, — (V, + M3) 


285 М.) — У, 


| a-s) 
. M(Vs..) = = “ы, n — M,) — Va). 
Since V, = M(V,.,) + V(M,.,), we obtain from (ii) above 
s(n — s) s(n — s) er 
vm asi лш MO EE. E SY 
z s(n — s) s(s — 1) ux 
V, GS ye Ma) + MS nu ren : . . (ш) 
Since Cov (Xa, хь) = kyaV when regression of x, on x, is linear, 
= 0.7 


Val f Vs 
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Whence from (iii) above 
s(n — 1)V, 4 
=i e м) е ene» 
When n = s in (iv), (n — s) = 0 and s(n — 1) = n(s — 1), so that 72, = 1. This is necessarily 


so, since the player then empties each urn. If n is very large in comparison with s, we may write 
(n — 1) œn œ (n — s), so that (iv) reduces to 


fF. 
EU TES-x)| c0 o0 c0 09 


From the algebraic viewpoint, it is usually immaterial whether we impose the restriction 
of replacement regardless of the size of the universe (п) or consider that л is indefinitely large com- 
pared with s. If so, (v) is definitive of the replacement condition ; but a peculiarity of this 
set-up is that either (iv) or (v) reduce to zero as л approaches infinity in virtue of the factor 
(n — M,) in the denominator. For that reason, it is appropriate to develop (v) independently 
from the variance formula of the non-replacement distribution when n is small 


s sx, 8 
ъа = Spa(l — pa) a — halt Se PI 


+ МО.) = ЗЕ) — Е) = <M, — ҖИ, + M2), 


eS s M? 

Vy = SV. + ŠM, — У, + М) 
s(s — 1 z 
=— v, + Sun — M) or DM) 


In virtue of linear regression we may write as before 


"s s.V, 
UV (е — И, + Mq — M 
Both (v) and (vi) uniquely depend on the distribution of the A-score, i.e. that of the urn com- 
position. If the и urns are all different and the A-scores run consecutively by unit steps as in 
Examples (1) and (2) the distribution is rectangular, and 
4—1 
12 


If the minimum number of red balls in an urn is т, the mean value (M,) of x, is m + (и — 1); 
and if m = 0, (v) becomes 


У, = 


P (и + 1) 
% (s — 1)(и + 1) + 3(2n — u + 1) 

We may now enquire in what sense we can partition V, the variance of the player’s score 
distribution into two components Vz and Vy respectively definitive of explained and unexplained 
variation, i.e. of variation arising from and independent of the source, viz. the circumstance that 
the urns do not all contain the same number of red balls. We can give the issue so defined a 
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unique meaning only if we regard the individual urns as sub-samples of a single universe which 
we can reconstruct on a Bernoullian basis, i.e. as a homogeneous system, by mixing the contents 
of the u urns. How much (Уу) of the variance of the B-score distribution then arises from the 
single relevant circumstance that the universe is stratified in virtue of the heterogeneity of the 
individual urns, we may then assign by deducting what the variance (Vz) of the players’ score 
would be if allowed to take s-fold samples from the reconstituted (Bernoullian) universe of un 
balls. "Though there is nothing arbitrary about such a definition of explained variation, it is 
important at the outset to recognise that it admits a unique solution only in virtue of an arbitrary 
property of the model, viz. that each sub-universe contains the same number (л) of items. With 
due regard to this limitation we proceed as follows. 

If f, is the number of urns containing x, red balls in the stratified universe, n, is the total 
number of red balls and M, the mean number per urn : 


T ano РА 
t= Уу fe; te= D> foe Маа, 
aco aco u 
The proportion of red balls in the universe as a whole is therefore 
Ма 
ЫШ" A 


If we define the unexplained component of variation (Vy) as above we may therefore write 


with replacement 


s E 
и 3 ) fM(n— M) . + (i 
without replacement 


_ s(un — s) _ s(un — 5) = хін 
Lid Se nun — 1)" масо A ; en 


In either case by definition 


y= Vi VT 
Whence from (vii) and (vi) sampling with replacement implies 
s(s—1) „ 
VaL Ve 
Hence from (ii) 
—1 1 : 
Vs =. WM.) and Vg— MUV.) V.) - 0) 


$ 


When there is ло replacement, we obtain from (viii) and (iii) 


ms [= = n — Juin — 2 + де 


ж(п—1) тип — 1) n(n — 1) 
n(s — 1) s(s — 1)(u — 1) 
uo pM. 2 Em jio Mj. ^. ШШ 


‘The last expression reduces to (ix) when л is indefinitely large. 

In seeking for a partition of variance referable to the source, viz. stratification of the uni- 
verse, we have here explored the result of removing the source of variation by deducting the 
variance of the player's score in sampling from a parent (Fig. 95) Bernoullian universe, i.e. 
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a universe constructed by pooling the contents of the urns and extracting s-fold samples from the 
composite urn so constituted. Provided x, is an exact multiple of u, we may of course replace 
the composite urns by w urns each containing э balls of which the proportion of red balls is p,. 
When this is so the variance of the player's mean score, i.e. V(M,.,), is necessarily zero and 
V, = M(V,.,) If the condition of replacement holds good V,,, does not depend on the total 
number of balls in the urn and it is immaterial whether we define in one or other way stated above 
what condition we impose when we make the sampling process homogeneous. This is not so 
when there is no replacement. Equations (vii) and (viii) do not then define the alternative stated 
above, viz. sampling from a universe of и urns each containing л balls and each having the same 
proportionate composition as the composite urn containing un balls. To that extent we may 
regard the criterion of explanation as ambiguous for the case of non-replacement.* 

With one notable exception, it is a common property of the class of models under discussion 
that regression is always linear in one dimension and in one dimension only. A special case, 
illustrated by Example 1 above, arises when: (i) we sample without replacement from a strati- 
fied universe of which each of (n + 1) sub-universes contains the same number of items ; (ii) the 
unit trial expectation from one or other sub-universe is 0, 1, 2... n. If the conditions last 
stated hold good, our numerical example illustrates two properties peculiar to the situation : 


(a) the distribution of the row-means like that of the column border-scores is rectangular : 


(b) regression of the row-scores on the column-scores is linear as is generally true of re- 
gression of column-scores on row-scores for other models here dealt with. 


Both peculiarities of this set-up are derivable by recourse to properties of figurate numbers 
dealt with in 11.07. We first recall that 


z~ (n =a) 


Fasi" Е, афу "Е, з = (0+ 1)» 
“—% 
can (na 1m р 
Я PG —COu-a-— wiy S › А Е) 


If the number of columns in the grid is (n + 1) and the A-scores run from 0 to n consecutively, 
the last expression defines the total frequency entries in a single row of the non-replacement 
Lexian grid in terms of the number of urns (n + 1) and fixed sample size (s). Since this does 
not depend on the row-score (7) or the column-score (c), (xi) therefore establishes the conclusion 
that the distribution of row-means is rectangular. ‘The conclusion that the row-means increase 
as an arithmetic progression follows from the figurate form of the general expression for the 


row-means, viz. : 
с=п 


x €. Qu(n — с)» 


М,.„= 


* The partition of variance defined by (viii-ix) which is equivalent to the familiar formula for the difference 
between the variance of the distribution of sampling in the Lexian and Bernoullian universes derives its rationale 
from postulates totally different from those which justify the identification of explained variation with the so-called 
best estimate of the variance of the column means in a one-way classification of scores of a grid such as one which 
summarises a plot yield experiment. A Fisher score-grid of this type specifies a single sample from a universe of 
scores and any parameters based thereon are therefore estimates. The Lexian score-frequency grid with which we 
here deal is a complete distribution summarising the results of extracting an indefinitely large number of all possible 
samples, and the appearance of the factor (s — 1) + s on the right hand side of (x) has no connexion with the problem 
of estimation. "Тһе equation itself is an exact description of how much variance arises from the circumstance of 
stratification in the entire universe of choice. 


4 
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From (xv) of 11.07 we know that 
осп 
= €. eun — c)s- = (т + Dn + ise — (n Ves en 
e=0 


By substitution in (xii), we obtain 


(т + (n + 2) a7 +2) (n—s) 
(s+ 2) (2) * +2) 

Mn+ 2) , (n—s) 
C+) (8+2) 


Me.s 


. M, = E(M,.,) = 


(n +2) 
+ 2)“ — М,). 


“М... — М, = 


Thus there is linear regression of the column-score on the row-score, the regression coeffi- 
cient being 


SAMPLE SIZE MODEL 


SAMPLE SCORE (X) 


o 1 2 3 4 5 
SAMPLE SIZE) os sss n nnn €6...00..000 000000000 TOTAL 
о ! 
oo 2 
000 3 
Оооо 4 
ООООО 5 


"Mob. VOTE s gew 


Fic. 96. Correlation between size of sample and score (number of red balls chosen with replacement) from same urn. 
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EXERCISE 12.05 
1. Repeat the computations shown above for Examples 1 and 2 when the number of urns is 
7 and the number of balls is 0, 1,2... 6. 
2. Repeat the computations for Example 3 when each of 64 urns contains 6 balls as follows : 


No. of red balls per urn: 0 1 2 3 £5. 8 
No. of urns: 1 6 15 20 15 6 1 


12.06 SAMPLE SIZE as A SOURCE OF VARIATION 


We shall now consider a set-up in which one score (x,) is the size of the sample the player takes 
from one and the same urn of balls, recording as his score (хь) the number of red ones in the 
sample. We denote the fixed proportion of red balls in the urn by р, so that there are pn red 
ones in the urn and gn = (1 — p)n other balls. This prescription admits two variants in virtue 
of the possibility of imposing the replacement condition or otherwise. 


Example 1.—The player draws from an urn containing 12 balls of which 8 are red, and separately 
records the result of taking samples of 1, 2, 3, 4 or 5 balls without replacement. 


Sample size (xq) 


1 2 3 4 5 ‘Total м... V... 
o| 165 45 | 9 1 0 220 н Als 
1| 330 240 | 108 32 5 715 m mm 
Player's score 2 0 210 252 168 70 700 m mm 
cp 0 0 126 24 210 560 н m 
4 o 0 0 70 175 245 m Hu 
5 0 0 0 0 35 35 5 0 
Total | 495 495 495 495 495 2475 3 2 
My. H 1 + $ м 2 = - 
Vina $$ Hj $$ $ н v — — 
| 


M(Vi.)) = 81955 М(И›.„)= $85 И(М,.ь)= 848935 VO.) $ = Ha Va 
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Example (2).—The player replaces each ball before drawing another but the set-up is otherwise 
as for Example (1), so that ky, = $. 


Sample size 
1 2 3 4 5 Total Mae.» LAT 
0 81 27 9 3 1 
1 162 108 54 24 10 
2 0 108 108 72 40 
Player's score —L— 
(x) 3 0 0 72 96 80 
4 0 0 0 48 80 
5 0 0 0 0 32 
Total 243 243 243 243 243 
Mya i з H H ap 
Voie i $ $ $ » 


M(V, .)) = 0767; M(V,. a) = $; VM, $) = 1233; V(My, a) = $ = Ka Vas 
M(V, . o) + VM, .)) = 2— Vai M(Vo. a) + V(Ms . a) = 7s = Voi 


VMs») _ вз; Уб. 


==. 
ГА Y, $ = т 


If х, is, as defined above, the score of е player 
Mya = .р; My = pEG) = p. Ma; 
Ms .a — M, = f(x, — Ma). 
"Thus regression is linear w.r.t. the player's score on the A-score, and 
ku =P; 
V(M,.,) = р^. Va - 5 y y x 2 (i) 


If there is no replacement 


(eae = PE (ns, — x): 


n—1 


Mi.) = Еда) — PL. + M2) 


= 20 мп - M) – 40. CELO  . € 


1 
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From (i) and (ii) we obtain 


Va = MV...) + VAM.) = P Mn — M) — POV, + py, 


ENS P — np) - 
n= mia—M)—-A ye. . . . . . @ 
We thus obtain 
VM.) p(n — 1). V, Я 

а= WM - М) р," (Ч 

When there is replacement 

Vy. = хард; M(Vo.a) = Mapas 

V, = М.р + ??V, . a E ^ 2 ew 3] 
PV. (vi) 


М, ФУ. 


The last expression is of course the limiting form of (iv) when n is very large, so that (n — 1) 
œn œn — M, and (np — 1) = пр. 

In this set-up the variance of the player's score distribution depends on two circumstances, 
viz. random sampling irrespective of sample size and variation w.r.t. sample size itself. There 
is a unique sense in which we can partition V, to exhibit how much of it is explicable in virtue of 
the distinctive peculiarity of the model, viz. sample size variation, if we conceive the procedure 
as an indefinitely repeated sequence of sets of trials involving the same distribution of sample 
size per set. So conceived, the number of items chosen in any one such set remains the same 
if for every trial of x, items we substitute M,, the mean sample size. This involves the restriction 
that E,(x,) is an integer. If there is no replacement the residual (unexplained) variance is then 


_ Mn — М.) 


Vo n—1 


9p - . 5 0 ` . (vii) 
Thence from (ii) and (iii) 


MW.) = Vo — as 


V, e Vy + Vy Ve + Os 


Since also V, = M(V,.,) + V(M,..), we thus derive 


p q - Ж 
V, = M(V,..,) + саа)" V(Ms.a) . : А . (viii) 
M с a { 
Ёк= Г ees 5] HG) у у DONO S 
When 7 is indefinitely large we derive the corresponding expressions for replacement 
Vy — M(V,.,) and Из = V(M,.,) . s d s 7 


Subject to the condition that there is replacement the variance of the player's mean score 
distribution therefore tallies exactly with the component of explanation, as is also true of the 


520 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


consequential relation of the player's score to that of the umpire in the models of 12.01, though 
not of the concurrent relation between the scores of the two players in the same set-up. But 
we arrive at this conclusion by considerations which are in no way comparable with those we 
invoke to interpret a one-way partition of variance of the players' score distribution w.r.t. the 
contribution of the umpire in the umpire-bonus model. 

A property of the umpire-bonus model in the domain of consequence is that the grid is homo- 
scedastic in the U-dimension, i.e. the variances of the player's score distributions are the same 
for all values of the bonus. The variance of the players’ score distribution for a fixed contribu- 
tion of the umpire is constant, its mean value being proportionate to the umpire’s score. This 
is not true of the model of this section. 


EXERCISE 12.06 


Repeat the computations of Fig. 96 for an urn containing 12 balls of which 3 are red, the player taking 
samples of 1, 2, 3 or 4. 


1207 Tur ORTHOGONAL LOTTERY MODEL 


"The model we shall now examine is a variant on the theme of 12.01, where we have made reference 
toit. Itis equivalent to a bonus set-up involving two umpires, the players being passive, and 
therefore a limiting case which arises when the maximum individual score of either of the two 
players is indefinitely small in comparison with that of either umpire. It is, however, worthy 
of special consideration for several reasons. As we shall later see, it has a special bearing on 
the assumptions inherent in the method of factor analysis due to Hotelling. It discloses how 
it is possible to generate a bivariate distribution with zero covariance when the variates are 
not statistically independent. It also gives us a clue to the procedure (Chapter 16) known as 
orthogonal transformation, a device by which it is possible to establish the statistical independence 
of two continuous variates. 

The rule for the model of Fig. 97 is as follows. An umpire spins once each of two wheels 
with marginal scores (1-5) whose frequencies conform to the expansion of ($ + 3). Опе 
player (A) records as his score (x,) the sum (x, -+ хз) of the scores registered at each trial by one 
or other wheel. The other player (B) records as his score (x,) the difference (x, — х). Fig. 97 
exhibits the joint distribution of the scores of the players. From the symmetry of the cell 
entries of the grid in both dimensions, we may infer that covariance is zero without recourse to 
computation ; but the reader may care to check this conclusion. 

We may regard the model of Fig. 97 as a particular variant on a more general pattern in- 
volving n wheels each of which the umpire spins one at a trial and л players, to. whom the umpire 
allocates some multiple of each wheel-score. We may then represent the system of scoring for 
2 players with 2 wheels by the following pattern : 


Xa = Aw, + Ах, and x, = Вх, + Box. . Я : . (i) 
The mean scores of the players are thus 
E(x,) = A,E(x,) + AsE(x:) and E(x,) = B,E(x,) + B3E(x;). 
If the two wheels are identical we may put E(x,) = M, = E(x;), so that 
E(x.) = (А, + А)М, and E(x,) = (В, + B,)M,. 
Thus the players have an equal chance of winning if 
(A, + As) = (B, + Bj) : : 5 E щш) 
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SCORE OF PLAYER А X,» x, +х, JOINT DISTRIBUTION OF PLAYERS SCORES 
SCORE OF PLAYER В х=х-х, 
Са Aue 
HH ' 20 BB s 
B dH 
4 
ва: 5 = BH 62^ Bag 
[| о ~ Н жс WB 
3 6 0 
EH °з! gg: ш *& 
HILHH TE 
5 4 
ШШ < 6-2 ШШ 4 o 
EB 472 [-| | o 


Fic. 97. The Orthogonal Lottery Model. An umpire spins the wheel twice, one player recording the sum as his 
score, the other the difference. 


For the covariance of their scores we have 
Cov (х„ ху) = Е(х,. хь) — Es) EQ) 
= E(A,x, + Asx;)(Byr, + Вх) — (A, + А3)(В, + Bj)M? 
A,B, E(xi) — A,B,Mz + А.В,Е(әз) — 4,B.M; 
+ (A,B, + ABy)E(xs, х„) — (A,B, + 4,B)M;. 
If we write V , for the variance of the single-trial wheel-score distribution, we therefore have 
Cov (Xa, xy) = (A,B, + 4,B3)V , + (А,В, + А,В) Cov (x,, x2). 

Since the scores x, and x, are independent Cov (x;, x2) = 0, and 

Cov (Xa, хь) = (А,В, + 4,B3)V .. 
The condition of zero covariance is therefore that 

DP Aes eS yoo S y 
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For the model of Fig. 97 A, = A, = 1 = B, and B, 1. Hence this condition holds 
good, as we have seen, and it is not inconsistent with (ii), i.e. the possibility that each player 
has an equal chance of winning. From (ii) and (iii) the condition that there may be no correla- 
tion between the scores of the two players with an equal chance of winning is 


B(A,—A,))=A({42+ A) . . «© . . (iv) 


For example, the following system of scoring makes a fair game in that sense, and reproduces 
the essential feature of the model, i.e. zero correlation: x, = 3x, + 4x, ; хь = 28x, — 21x,. 
We might complicate the procedure by using three such wheels, the general pattern of the 


scores of three players being then 
Xa = Аа + Age, + Asta 5 


хь = Byx, + Box, + Baxs; 
х„ = Сух, + Cy, + Cory. 
For the 3-wheel case, as the reader may check by the procedure employed above, 
Cov (xa, xy) = (A,B, + А,В, + ABV 2; 
Cov (Xa, х.) = (АС, + A,Cs + AC) V 2; 
Cov (xy, х.) = (В,С, + В,С, + B4C3)V 2. 


The condition of zero covariance is therefore 
A,B, + A,B, + A,B; = 0 
АС, + A.C, + A,C;=0 5 - : Е . (у) 
B,C, + B.C, + BC, = 0 


More generally we may say that the condition of zero covariance for such a system of scoring is 
that the sum of the products of corresponding constants for any pair of definitive equations is zero. 
This is consistent with the condition that each player has an equal chance of winning. If there 
are only 2 wheels and 2 players, the condition that the variance (V4, etc.) of the score distribution 
of each player is the same is consistent with an equal chance of winning or with zero covariance 
but not with both. For the 3-wheel game we may thus express the variance of the player's score 
distribution 
V, = E(x, — M; = AjE(x, — М.) + А$Е(х, — М.) + AsE(v, — Ма) 
+ A AsE(v, — М„)(х, — Mz) + A,AsE(x, — М.з — Ma) 


+ AsAsE(x, — M;)(xs — M,). 


Whence we obtain 
V, = (43+ 43+ А .. W; 


V, = (Bi + В + By. . Wa; 
V, = (СЇ + Cic Сз. . Wa 


"Thus equal variance of the scores of the 3-player set-up implies 
(42 + 48 + А) = (Bi В: + B3) = (Ci + C3 С)... (м) 
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Similarly for the 2-player set-up with only 2 wheels, it is (Aj + 42) = (В? + Bj. The 
set-up in Fig. 13 is consistent with this condition and with zero covariance since 
(42 + А) = 2 = (B? + Bj. When the umpire spins two identical wheels, the joint con- 
ditions of unit variance and zero covariance is 


Aj + Ap=1= Bi + B} and A,B, + A,B, =0; 


1 1 
A, = —~== A, = B, d B,=—=; 
1 l2 2 ; ап 2 ES 
xy Xa х Xa e 
a d = 
ager Va V2 (vit) 


It will be of interest at a later stage to ask what aspect the correlation grid would assume if 
the number of score classes were so large as to tally closely with the continuous normal distribu- 
tion. We have (Chapter 3, Vol. I) seen that the binomial (3 + 3)? defines a distribution of 
which this statement is true. Table 1 exhibits the correlation grid of the scores of the players 
when the universe of scores consists of 21 classes (0 to 20 inclusive) so distributed. The system 
of scoring is x, = Ху + x, and x, = x, — x, as in Fig. 91. 

"The ace-contour indicative of zero covariance again asserts itself ; but if our aim is to explore 
whether zero convariance in a normal universe would conform to the requirements of statistical 
independence, we are entitled to group our data in conformity with the implicit assumption of 
continuity as in Table 2. 

Each cell of Table 3 exhibits (above) the corresponding entry of Table 2 expressed as a 
proportionate frequency and (below) the frequency assigned by the product rule in conformity 
with the row and column border scores of Table 2. ‘The correspondence is not very good ; 
and it is therefore clear that a bivariate distribution which closely approaches normality in both 
dimensions does not guarantee independence as a necessary corollary of zero covariance. 


EXERCISE 12.07 


The following are the weights (4,, Aa, etc. in the first line, B}, B,, etc. in the second, and so on) for the 
player's score in accordance with the general pattern for player К: x, = Куху + Kix, Куз... 
when x, Xa etc. represent the score at one trial of each of the roulette wheels with scores (1, 2, 3, 4, 5) 
and score frequencies (1 : 4: 6:4: 1) as in Fig. 97: 


Wheel 

Player 1 2 3 4 5 
A 1 3 2 4 1 
B 4 0 n 1 1 3 
c 1 2 4 2 0 
D 2 1 3 1 2 
E 0 2 1 1 4 


1. Determine the variances of the 5 players’ score distributions and those of the first 3 players 
when they base their scores on those of the first 3 wheels. 


4* 
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TABLE 2 
0-2 3-5 6-8 9.11 12-14 15-17 18-20 TOTAL 
(—10)-(—8) = — 45 121 45 = — 211 
(= 7)-(— 5) — 252 3630 13725 3630 252 = 21489 
(—4)-(— 2) 45 [Е 3630 63000 | 108900 63000 3630 45 242250 
(= 04+ 1) 121 13725 | 108900 | 275184 | 108900 | 13725 121 520676 
(+ 2)-(+ 4) 45 3630 63000 | 108900 63000 3630 45 242250 
(+ 5)-(+ 7) 252 3630 13725 3630 252 = 21489 
(+ 8)-(+ 10) — — 45 121 45 — — 211 
TOTAL 211 21489 242250 | 520676 242250 21489 211 1048576 
=== 
TABLE 3 
0-2 3-5 6-8 9-11 12-14 15-17 18-20 
(—10)-(—8) — — 0-000 0-000 0-000 E e 
0-000 0-000 0-000 0-000 0-000 0-000 0-000 
(— 7)-(— 5) = 0-000 0-003 0-013 0-003 0-000 — 
0-000 0-000 0-005 0-010 0-005 0-000 0-000 
(= 4)-(— 2) 0-000 0-003 0-060 0-104 0-060 0-003 0-000 
0-000 0-005 0-053 0-115 0-053 0-005 0-000 
(= 1)-(+ 1) 0-000 0-013 0-104 0-262 0-104 0-103 0-000 
0-000 0-010 0-115 0:247 0115 0-010 0-000 
(+ 2)-(+ 4) 0-000 0-104 0-060 0-003 0-000 
0-000 0115 0-053 0-005 0-000 
(+ 5)-(+ 7) E 0-013 0-003 0-000 — 
0-000 0-010 0-005 0-000 0-000 
(+ 8)-(+ 10) = 0-000 0-000 = = 
0-000 0-000 0-000 0-000 0-000 


9. Make a table of correlations of players' scores of the pattern 
D E 


A 


B 


c 


tj X G ш> 
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8. Make a second table showing what fraction of the variance (V) of the score distribution of each 
player is attributable to each score component Куху, Кх, etc. 


4. Check all the formulae of the preceding section by direct calculation of the above. 


5. A lottery wheel like that shown in Fig. 13 has 8 sectors with scores 2 and 8 each in one sector 
and 4 and б each іп З sectors. Investigate the joint distribution of the players’ scores, if they respectively 
record the score-sum of 2 double spins and the difference between them. 


6. А lottery wheel of 32 sectors carries score values 1 or 16 each in 1 sector, 4 or 13 each in 5 
sectors and 7 or 10 each in 10 sectors. Investigate the players’ joint score distribution if 

(i) A records the score sum of 2 spins, B the score difference ; 

(ii) A records the score sum of 3 spins, B 5 times the score difference of the double spin. 


1208 THe STANDARD SCORE SYMBOLISM 


We have already used the expression standard score or critical ratio in connexion with normal 
significance tests, its definition being as follows : the standard score is the ratio of the raw-score 
deviation from the mean to the standard deviation of its distribution. In the theory of the 
significance test, our assumption is that both the mean and s.d. in this context are their true, 
in contradistinction to their approximate sample, values which we commonly use to make the 
best of a bad job. So defined, the standard mean score of a sample drawn from a normal uni- 
verse is normally distributed with unit variance ; but the distribution of the approximate standard 
score then approaches normality only if the sample is large, and its correct distribution is that of 
the t-ratio mentioned in Chapter 7 of Vol. I and dealt with in Chapter 16 below. In what follows, 
the reader may judge from the context whether we employ the term in the exact or approximate 
sense. Either way, the definition does not presume a normal distribution; and either way 
standard scores have certain practical advantages, which commend their use, especially in 
situations involving the use of correlation and regression formulae. It is for this reason that 
psychologists employ them extensively. 

A special advantage is the simplification of the algebra of correlation, since all such scores 
have the same mean, i.e. zero, and the same variance, i.e. unity. We shall here use za, 2, as 
the standard scores corresponding to the raw scores x, and хь, i.e. 


X, x, — М, X, x, — М 
—=%4, and = 20 = ———, 
Ta Ta оь оь 
5 e | 3 Vows 
vos View Le GEO a 1, etc. 


By definition we have 


E(X, . X») (2 X, 
Ta 0, 


) E(z, . з). 


'Thus the product-moment coefficient of two raw-score distributions is the covariance of the 
corresponding standard scores. If there is linear concomitant variation, we may write 


XQ = Aux. + Аха. and Xa = AyXy + А,Х,.,; 
V, = АУ, + AV aoi 
X, dao. Xu | 4.®.„ Kao 


Oa Ta Ou Oa Ca.o 


Tab 
9.0 
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We may then put 


LN 


% 


In standard score form we may then write 


and Аа. _ i 
Oa 

and Bere y 
оь 


2, = ay, + 45.4; 
By = Ьуз, + bor .05 
ots Vra = GV ex + 4ш.» 
“G+ a=1=B +8 


Also as above 


Таъ = E(Za - 25) = GubyE(22) + a,b E(u» Za .0) 


+ а,,Е(а, « 25.0) + a» BoE (Ze.0 20.0) 


== ан. 
Since ш = 1, we have 
Tap = 4,0, 


If regression of x, on x, is linear we have 


= V(1 — ey1-— 6) 


М». — M, = №... X, = Ey. (хь — My), 


га. [E - hc) 
pa оь к оу oq)" 


Where regression is linear we have seen that 
kra 


Hence the preceding equation becomes 


Es 
Ta 


Е. (23) = таъ. Za 
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(i) 


(ii) 


(iii) 


We may express this result as follows : if regression of the B-score on the A-score is linear, the mean 
value of standard B-score for a fixed value of the standard A-score is obtained by multiplying the 


latter by the correlation coefficient. 


To gain familiarity in the use of standard scores, we may here develop the formula for 
partial correlation cited in 9.04 of Chapter 9, Vol. I on the assumption of linear concomitant 
variation. We assume that there are 2 umpires, and in standard form our definitive equations 


are 


ж = AyFu + Avy + aa.) Gta + а = 1 — Ун; 


Bp = buzu + bute Duy; B+ 0 4 = 1 


In this set-up, the total variances of the players’ score distribution are V,, = 1 = V. 


wise И, = 1, so that 


Tay = а, + Gubu; Tau = Gu; Tou = bu; 


te Tay — Tau» Tou = ау. 


Like- 
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Our aim is to determine the value of the p-m (product-moment) index (7, .,) w.r.t. the A- and 
B-scores, when the source of concomitant variation arises from the W component alone, i.e. 
when 2, remains fixed, so that 
У.а = а а = 1— а and У... = 6 +00 = 1—8 ; 
Соо (Za ou» Zo u) = а,Ь, ; 
аф, а, Таъ — Tou Tou 
"Таъ . 


VV Vase УО Л =М) "V TT re) 


Similarly, we may derive 


Таъ — Taw + Yow 


Уп) e 


Tob.w 


12.09 REGRESSION AND CONCOMITANT VARIATION 


‘The method we have used to derive the equation of partial correlation in Chapter 9 of Vol. I, 
as also in 12,08 above, and conclusions we have established in connexion with the models of 
12.01-12.06 bring into focus an issue which calls for further comment. With that end in view, 
it is appropriate to recall an important logical distinction, which we may state as follows : 


(i) if B must occur when A occurs but may also occur when A does not occur, we say 
that A is a SUFFICIENT condition of B’s occurrence ; 


(ii) if B cannot occur unless A also occurs, but may not always occur when A does, we 
say that A is a NECESSARY condition of B’s occurrence ; 


(iii) if B cannot occur unless A also occurs, and must occur if A occurs, we say that A is 
both a sufficient and a necessary condition of B's occurrence. 


We may clarify the distinction, if we invoke two antecedents A and C. If B occurs only 
when both A and C occur, neither A nor C is a sufficient condition of B’s occurrence but each 
is a necessary one. If B occurs only when either A or C occurs alone, each is a sufficient but 
neither is a necessary condition of A’s occurrence. 

We have shown in this chapter that 


(a) the equation of partial correlation follows from the law of linear concomitant variation 
(L.C.V.), i.e. that L.C.V. is a sufficient condition for its validity 


(b) a law of linear regression (L.R.) is not a necessary consequence of L.C.V. and conversely 
L.C.V. is not a necessary accompaniment of L.R. 


"Thus linear regression is nof a necessary condition of the validity of the equation of partial 
correlation. That it is not a sufficient condition is demonstrable by recourse to the model of 
12.02. We can modify the latter by postulating a third player C who takes c cards from a pack 
without replacement after A and B have respectively taken a and b cards. We shall assume that 
each player records his heart-score. The only meaning we can then attach to the correlation 
(ть...) of the B- and C-scores in the absence of any effect due to the choice of A implies the 
elimination of A’s choice. The formula is then the same as for r,; if we substitute b for a and 
€ for b, i.e. 


bc - 
ncm ee . . . . = 10) 
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To test the validity of the equation of partial correlation in this set-up, we shall require to deter- 
mine 7, Fa and Fea when all three players draw. We already know that 


aco add f 
Toa = — Ja : Е А д К 


For M,, М, Va, V, we may employ ће expressions already derived in 12.02. Since we have 
shown that the prior choice of A does not affect the variance or the mean of the B-score distribu- 
tion, we may also write 
Meee ani Ue ice MM M TET 
n—1 
We may write the mean value of x, for a fixed value of x, and x, as M,, ,,, and its value as 
_ np — Xa — x) 
Mi ac 5 
In our grid notation 
M,.,— Ey.a(Me.ar) and M,., = Ea. (Me. a). 
Whence we derive 
M dup — xa) — СЕъ.„(хь) спр — x) —— be(np— xa) 
с-а 


Етан ар a—a—b (т—ал—а—®' 


“м = г—= EM ЛЕЙ UN) 


Similarly 
спр — x») — cE,. (x) — с(пр — x») ac(np — хь) 


ПЕТЕ NEN aea GR ncacb 
4 _ 91р — хь) 
QU. РА E p ^ A 5 . (у) 
From (iv) we derive 
" 0p.M, 40, + М?) _ асра. 
sa зш ирис а с б = 
EE 
Соо (xas x) = —— 1: 
ac T 
^" ZEN E . . è . . (vi) 
Similarly, we obtain 
А ae be К 
з= ENET А 5 Е ч . (vii) 


From (ii) and (vi) we thus obtain 
a (n—a—05»—a—2o). 
(п — а)? (п — b)(n — с) 4 
av bc 
(n — a)v(n — Bn — o) 


(1 — ra) 1 — nz) 


Таъ * Тас = 
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Also from (ii) 
— = n" t 
Teo — Tab Tac = veu 4 (n — Bn — 9 


_ fie — Tay e fas Vibe 
"vü-mü-5z  va-a-bn—a-—ó 


But we have seen, as in (i) that 


bc 
Tyc.a = рини 


"Thus the expressions оп е right of the last two equations are unequal, i.e the relation defined 
by (iv) of 12.08 on the assumption of L.C.V. does not hold good. Nevertheless L.R. continues 
to apply in both dimensions, since we can write (iv) and (v) in the form 


np — (X, ар) 


ie = eee s 
ncp o(X, + bp) * 
М,.„— М, AIT ah es 
c c 
nM,Q2—M.—— .X, and M..,—M,— — sakes 
n—a n—b 


What is common ground to L.C.V. and L.R. is that each suffices to guarantee that the product- 
moment index has its essential summarising properties, in that its limits of + 1 define perfect 
correspondence. Its zero value consistent with independence is inherent in its definition, since 
independence implies zero covariance. "That linear regression in one dimension alone suffices 
to define the limits of r4, follows from the fact that L.R. implies the identity 


i og o Fb) _ Ve МР.) 
ab NEL V, : 


When correspondence is perfect V,., = 0 = M(V,.,), so that 72, = 1. The summarising 
properties of the p — m index when L.C.V. holds good follows from the structure of the 2 types 
respectively definitive of a consequential and a concurrent relationship. ‘Thus for one common 
bonus (xu) 


"ET cue ИЕ 
- pM SERVE 

"me AVE 

a=- TV (Ж, А, NBV. + BV, 


Perfect correspondence in this case arises when the player’s individual score is zero, so that 
Va.o = 0 = V,.,, and both the foregoing expressions reduce to unity. 

We may sum up the foregoing discussion : 

(a) linear concomitant variation and linear regression have this in common that each is a 


sufficient, neither being a necessary, condition of the limiting values set by perfect 
correspondence to the product-moment index ; 
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(b) linear concomitant variation is a sufficient condition of the validity of the equation of 
partial correlation, but is neither a sufficient nor a necessary condition of linear re- 
gression ; 

(c) linear regression is not a sufficient nor a necessary condition either of L.C.V. or of the 
validity of the equation of partial correlation ; 


(d) L.C.V. defines a causal nexus in the sense that it prescribes two different equations each 
definitive of a consequential relationship as an adequate and explicitd escription of a 
concurrent relationship ; 


(e) L.R. is a descriptive device which implies no causal nexus, since regression may be 
linear in both dimensions, in one dimension or in neither when the relation between 
the variates is concurrent. 


CHAPTER 13 


ASSUMPTIONS UNDERLYING ANALYSIS 
AND SYNTHESIS OF VARIANCE 


13.00 ANALYSIS OF VARIANCE 


No statistical technique has attained in so short a time greater popularity than the one referred 
to in the title of this chapter; and it is safe to presume that any reader of this book will have 
at least a nodding acquaintance with it. One reason for its extensive use in biological and socio- 
logical work is the existence of manuals which give very explicit directions for the necessary 
computations by recourse to examples chosen from contemporary investigations. To the 
student who understands the logical credentials of the method and the algebraic assumptions 
of the significance tests it invokes, such instruction is invaluable. Since it is accessible in 
any well-stocked library, there will be no need to burden ourselves in this context with arith- 
metical illustrations which the student will find set out in such texts as those of Snedecor, 
Hagood, Tippett and others. 

In what follows our aim is different. It is all too easy to be led astray by extraneous simi- 
larities, if one relies on exemplary material as a guide to the best way of dealing with a statistical 
problem. Seemingly similar situations in the conduct of enquiries may indeed raise essentially 
diverse logical issues and may be consistent with very different admissible assumptions about 
score distributions. Consequently, recourse to a statistical technique without a clear grasp of 
its rationale is an invitation to its misuse ; and the theme of this chapter is no exception to the 
rule. For reasons stated in 11.00, we shall not attempt to set forth the appropriate significance 
tests at this stage. They will be the subject of treatment in Chapter 16. Here our concern is 
to clarify what we can accomplish by means of the Analysis of Variance, and also what we cannot. 

At the outset, it is important to recognise that the term itself covers several statistical pro- 
cedures of which some have wider applicability than others. Though their several limitations 
have been the theme of discussion in scientific journals,* notably by Churchill Eisenhart and by 
Lee Crump, whose views we quote below, the student who is not a professional mathematician 
can turn to few, if any, accessible sources from which it is possible to get into focus what factual 
postulates justify the relevance of the algebraic expressions to a practical situation. Indeed, 
the intricacy of the relevant compatations, so adequately expounded elsewhere, and the novelty 
of the mathematical technique invoked to justify the appropriate tests of significance, alike con- 
spire to defeat the attempt to do so, unless we distinguish sharply between the following issues : 

(a) the derivation (as in 11.05) of computing devices which rely on tautologies of a grid, 

and as such have no necessary connexion with the theory of probability ; 

(b) what causal assumptions about the real world are implicit in the several procedures we 

shall discuss in this chapter ; 

(c) what factual assumptions we implicitly make about score distributions in prescribing 

tests which are the theme of Chapter 16 ; 

(d) the formal algebra (Chapter 15) of the distributions invoked as a basis of such tests. 


* S. Lee Crump (1946), * Estimation of Variance Components in Analysis of Variance’. Biometrics (Amer. Stat. 
Ass.), 2, 7. 

Н. E. Daniels (1939), * Estimation of Components of Variance’. J.R.R.S. Supp., 6, 186. 

Churchill Eisenhart (1947), ‘The Assumptions underlying Analysis of Variance’. Biometrics, 3, 1. 
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1301 MULTIPLE CRITERIA OF CLASSIFICATION 


Statistical treatment of practical issues is possible only when we can score our observations in one 
of two ways: (a) taxonomically, as when we say that the number or proportion of items with 
an attribute A (e.g. sickness, colour) is some number x in a sample of size r ; (b) representatively, 
when we assign a measurement (e.g. height, weight) or a number (e.g. wages, seeds per pod) to 
each sample item and specify the sample score by a sum, mean or other figure which takes account 
of their individual values. Having assigned scores of one or other sort to our observations, we 
may classify them with a view to disclosing some agency which makes them vary. For example, 
we may divide 

(i) a population of diphtheria patients into those who respectively did and did not receive 
serum treatment, scoring the sub-samples taxonomically by the proportion of fatal cases 
in each ; 

(ii) a batch of children of the same age and sex into groups respectively travelling at least two 
miles and less than two miles a day to get to school, scoring the result representatively 
by recording the median place in the terminal examination or the mean number of 
absences in a year. 


In either case, the practical issue is reducible to the same type of question when stated in the 
language of statistics used by the predominant school of the last two decades, that of 
R. A. Fisher. Our first concern is to decide whether the magnitude of the difference observed 
is consistent with the null hypothesis that the sub-samples come from the same universe. If we 
may legitimately conclude contrariwise, we may then seek to arrive at some estimate of how the 
universes themselves differ. If we confine our attention to a single criterion of classification, 
the effects of treatment or travelling long distances in the foregoing examples, we may often 
make a two-fold split ; but it is sometimes difficult to exclude sources of variation other than 
those which are our main concern and therefore convenient to divide our material into more 
than two classes within the framework of the same criterion. One way in which we may then 
proceed is the theme of what follows. 

Let us first be clear about what we mean by class and by criterion of classification in a situa- 
tion involving two criteria and two or more classes with respect to each criterion. We shall 
suppose that we have before us figures w.r.t. a single determination of the red blood cell count 
of one male and one female of the Angora, Blue Bevran and Polish Giant breeds of rabbits. We 
may then lay out our scores (x;;) gridwise as below. 


TABLE I 
Angora Blue Bevran Polish Giant Row 
Male Xu Xn Xn 
Female Xe Xap х 
Соштп i=1 i=2 i=3 


Here we have two criteria of classification sex and breed, involving 2 classes w.r.t. the first and 
3 classes w.r.t. the second. It may well be that sex affects the score value in the sense that the 
mean score of one sex differs from that of the other in the absence of any other source of variation, 
i.e. agency responsible for score differences. To say that sex is the only source of variation so 
defined would signify that the scores of ail males are the same and those of all females are the same, 
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the single male score value (which is then the male mean score) being different from the single 
female score value (which is then the female mean score). ‘Thus the variance (V,) of the score 
distribution within each row will be zero, so that M(V,) — 0. Hence the variance of the row 
mean scores V(M,) is equal to tbe total variance (V) in virtue of the tautology of the score grid, 
V = M(V,) + V(M,). Contrariwise, the column means will be identical so that V(M,) = 0 
and V = M(V,). By the same token, we might write V = V(M,) and M(V,) = 0 if the only 
source of variation were the breed, in which case also V(M,) = 0 and M(V,) = V. 

In general, neither proposition last stated will be true. For we know that any single 
determination of the r.b.c. is subject to error of observation and to individual circumstances 
unconnected with either sex or breed. In virtue of tbese residual sources of variation, the 
scores within a row or column will differ in the absence of any row-effect attributable to sex or 
column-effect attributable to breed. Because of the residual effect alone, both row means 
and column means may therefore differ. If there is no row-effect, the fact that V(M,) exceeds 
zero is then attributable to the residual source of variation alone, as is the fact that V(M,) 
exceeds zero when there is no column-effect. If there is neither a row- nor a column-effect, 
the values of both V(M,) and V(M,) depend uniquely on the residual source, and we may 
expect to discover some relation between them, consistent with that assumption. 

To say that there is no sex-effect in this context is to say that row samples come from one and 
the same universe ; and we express this alternatively by saying that the universe is homogeneous 
w.r.t. the row-criterion of classification. To say that there is no breed-effect is to say that 
column samples come from the same universe and that such a universe is homogeneous w.r.t. 
the column-criterion. To say that the universe is homogeneous in both dimensions is the 
same as saying that the residual sources suffice to account for all variation. 

One class of procedure subsumed under the term analysis of variance has as its aim to decide 
whether a system of scores is homogeneous w.r.t. one or more criteria of classification, i.e. to test 
the null hypothesis that one or other putative source of variation defined by the classificatory 
set-up is negligible. Thus the null hypothesis is that sex or breed or both do not significantly 
affect the r.b.c. in the example last cited. If our 2-way table for 2 criteria of classification has 
с columns, 7 rows and hence rc cells in all, homogeneity w.r.t. both criteria signifies that each 
row-set is a c-fold, each column-set is an r-fold and the entire set of scores is an rc-fold sample 
from one and the same universe. If so, our problem is: 

(a) to define consistent relations between parameters of the score distribution referable to 

either dimension alone and to the grid as a whole ; 

(b) to test the consistency of such parameters. 

Any significance test specified by (b) must naturally rely on certain assumptions about the 
score distribution of the putative common universe. Such assumptions may be more or less 
plausible in a given situation; but we can define criteria of homogeneity in the sense im- 
plied by (a) without invoking them. It will therefore be convenient to reserve discussion of 
(b) till a later stage. 

A corresponding dichotomy is helpful, when we turn to other classes of problems to which 
the expression analysis of variance may refer. If the universe is not homogeneous, we are 
entitled to ask how much of the variance is attributable to one or other source. "The end in view 
may then be 

(i) to make an exhaustive balance sheet exhibiting what fraction of the total variance arises 

from each source ; 

(ii) more modestly, to assess the residual component with a view to specifying the sampling 

variance of a set of class means in the absence of variation arising from other sources. 
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More explicitly, (i) signifies a specification of the extent to which we should proportionately 
reduce the variance of the parent universe, if we eliminated one or other source of variation, 
e.g. by replacing all males by females or vice versa in the foregoing example. It is important to 
notice that we can reduce it in two ways, and we have at this stage no reason to believe that 
the results would be the same. They are indeed the same only if we make certain assumptions 
which have no relevance to the discussion of homogeneity. 

To appreciate the meaning of (ii) above, we should recall that the observed variance of the 
column (breed) samples of our foregoing illustration will partly depend on sex if sex is a true 
source of variation. If our aim is to ascertain the variance of each column mean regarded 
as a parameter of the breed effect alone, i.c. the true variance of the mean of males alone or 
of females alone for each breed, our only concern is therefore with one component (the 
residual) of variance. 

To construct an exhaustive balance sheet of all the components of variance or to specify 
a particular component, we have to rely on certain assumptions about the ways in which the 
several sources of variation contribute to the individual score value; and this raises an issue 
which does not arise when our sole aim is to test the null hypothesis that one or other source of 
putative variation is negligible. Needless to say, we can ask no more of our sample than an 
estimate of any component of variance. There then arises the question : to what sampling error 
are our estimates subject, i.e. what are their fiducial or confidence boundaries ? Here we must 
introduce other assumptions concerning the distribution of the score components. We shall 
find it easier to steer a way through a labyrinth of practical difficulties, if we examine the 
simpler issue: how is it possible to construct the balance sheet? Our first task will be an 
attempt to visualise random distributions of samples classified w.r.t. one, two or three criteria 
by recourse to statistical models. It will then be possible to exhibit the formal logic of 
analysis of variance by recourse to the symbolism of 11.05 without the danger of losing ourselves 
in a maze of symbols. 


13.00 THE COMPLETE SAMPLING DISTRIBUTION 


In Vol. I we have become familiar with the chessboard device as a means of setting out the 
distribution of variously classified r-fold samples from a static n-fold universe in conformity 
with the principle of equipartition of opportunity for association ; but we have also acquainted 
ourselves with the advantage of a somewhat different approach in 12.00, where we have spoken 
of a universe in action, i.e. as a random distribution of all possible r-fold samples. In the entire 
assemblage of samples constituting such a random distribution every item (score value) is 
necessarily present with the same proportionate frequency as in the parent universe. This 
is sufficiently evident from the build up of the 3-fold toss of a penny when we score heads as 
1 and tails as 0: 


0 1 0.0 0.1 1.0 1.1 
0 | 0.0 | 0:1 0 0.0.0 | 0.0.1 | 0.1.0 | 0,1.1 
1 | 1.0 | Rok 1 1.0.0 | 120.1 | Tono | 121.1 
Two-fold Toss Three-fold Toss 
Heads 4 Heads 12 


"Tails 4 "Tails 12 


536 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


In the same way we may lay out as below the 2-fold toss distribution for a tetrahedral die 
with face scores 1, 2, 2, 3 as in Fig. 70 of Vol. I, and the reader may check the rule by con- 
structing a similar grid for the 3-fold toss : 


1 2 2 3 
1 1.3 1.2 | 1.2 | 1.3 
2 2.1 2.2 2.2 2.3 
2 2.1 2.2 2.2 2.3 
3 311 3.2 3.2 3.3 
Unit trial scores. у . 1 2 4 
Numbers of each. . . 8 16 8 


The fact that the distribution of individual score values, i.e. scores of unit trials, in each cell 
entry of the chessboard lay-out for the r-fold sample is the same as that of individual score 
values in the parent universe, i.e. the same as the unit sample distribution, signifies that the mean of 
all individual score values in the chessboard lay-out of the distribution sample classes is identical 
with that of the unit sample distribution. For the same reason the variance of the distribution 
of individual scores in the entire assemblage of chessboard samples is likewise identical with 
that of the unit sample distribution. If we postulate that the relative frequencies of such sub- 
universes tally with the relative frequencies of corresponding 7-fold sample classes in a random 
sample distribution, we can therefore conceive of each class of samples as a class of sub-universes 
within the parent universe. 

To develop this conception further without losing sight of its visual meaning, we may here 
usefully pause to recall some elementary properties of sampling distributions. In Vol. I we 
have drawn a distinction between the following parameters of a sample distribution classified 
w.r.t. one criterion of sample structure (e.g. number of hearts in the sample or total number of 
pips face upwards) : 


(а) the unit-sample variance (V,), being the variance of the distribution of individual 
scores in the parent universe ; 

(b) the variance (г. V.) of the distribution of the sum* of individual score values in r-fold 
samples drawn independently from the parent universe with replacement ; 

(с) the variance V(M,. .) = (V, = r) of the distribution of the mean (M,. ,) of individual 
score values in such r-fold samples ; 

(d) the observed variance V',. , of the distribution of individual score values (x;) whose mean 
value is M,. , within a particular sample, so that 

Jer E 2 
Va. Gu— MEM. 78 (i) 


j=1 " 


*Note—In the domain of binary taxonomic scoring, the unit scores are respectively 0 and 1 and the terms of the bino- 
mial (q + р)! define the unit sampling distribution with mean р and variance И, = pg. The r-fold score sum is then the 
7-fold sample raw score (0, 1 . . . 7) whose distribution corresponds with successive terms of the binomial (q + р)” 
with mean rp and variance rgp. The r-fold sample mean score is the proportionate score whose distribution like- 


2 
wise accords with successive terms of (g + p)! for score values 0, 7, . . . 1, the mean of this distribution being р 
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In accordance with the notation of 11.05, we may write (i) more economically in the form 
Е4х,— М...) = И,.,= Еа) – М, . - +» . (ii) 


In Chapter 7 of Vol. І we have seen that the expected (mean) value of е sample variance 
(V,. ,) is somewhat smaller than that of the unit sample distribution, being in fact defined by 
the relation 


r— 1l, 


M(V,. 5) = V 5 б К В . (ii) 


£ 


We shall now derive this relation by recourse to a notation which makes the meaning of 
every step explicit. Let us first be clear about what we call the mean sample variance in 
this context. The statistic (V,.,) defined by (i)-(ii) is an r-fold sample statistic. "Тһе statistic 
defined by (iii) is the mean value of this sample statistic in the universe of all r-fold samples 
with relative frequencies assigned by successive application of the product rule. We may 
make the distinction clear by: (a) using E, for the operation of extracting the universe mean 
of the random distribution of any sample parameter; (b) employing the dot notation to dis- 
tinguish any parameter of the r-fold sample (e.g. M,., or V,., for the mean score or variance) 
from a parameter of the universe (e.g. M, or V,). With these conventions we may write 


M(V,..) = ЕДУ,. ) = EJE (37) — M7] = E, E(x) — ЕДМ? ); 
V(M,.,) = E(M,., — М,) = ЕМ?) — М}; 
M(V,.») + V(M,.s) = E, . E(x?) - M? = E,  E(x, — Mj. 


The expression on the right of the last equation is the mean value of the square of individual 
score deviations from the true mean in the universe of all r-fold samples, i.e. that of the 
unit sample distribution, so that 


M(V,.,) + V(M,.s) = Vue 


We have also seen that 


V. 
V(M,.,) = 3s 
MV) = Ve = 5 =” = н. Nn тер 


We may conveniently visualise a complete sample distribution involving one criterion of 
classification by setting out each permutation of individual scores in the chessboard cell entries 
as rows of a 2-dimensional score grid. Fig. 98 and Table 2 show the relevant calculations for 
a score grid exhibiting the random distribution of 3-fold samples of a flat circular die with 1 pip 
on one face and 2 pips on the other. Тһе binomial (3 + 4)! then defines the unit sample dis- 
tribution, so that M, = апа V, = 1. Alternatively, we may lay out the distribution more 


and the variance pq + r in accordance with (c) above. On this understanding, we may regard taxonomic scoring 
in the binary universe as a special case of representative scoring. 

More generally, we speak of the unit sample distribution as a binomial variate, if the frequencies of individual 
scores correspond to successive terms of (q + p)* in the range m to m + aAx, when the frequency of a score m + xAx 
is given by az). D*.g*-*. The mean (M) of the unit sample distribution is then т + apAx and the variance 
apq(Ax)*. What we call taxonomic scoring in the binary universe signifies that a = 1, т = 0, Ax = 1 so that 
М, = p. The binary universe of the flat circular die with 1 pip on one face and 2 on the other does not fulfil this 
specification, since Ax = 1, but m = 1 and М, = (p + 1), though V, = pq as when the method of scoring is taxo- 
nomic. When p = à = q and a = 1, the distinction between a rectangular and binomial variate breaks down. 
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economically by recording the frequencies of all samples containing the same set of individual 
score values regardless of order. "Table 3 employs the frequency grid lay-out for the complete 
random sample distribution for the 4-fold toss of a tetrahedral die with 1 pip on one face, 2 pips 
on two other faces and З pips on the fourth. The u.s.d. accords with terms of (3 + 3)*, so that 
M, = 2, V, = 3, and M, = 2. The cell entries specify the number of permutations consistent 
with the same combination of individual scores in the 4-fold sample. "Thus there are 4 permuta- 
tions of toss-order consistent with the sample structure 1113 and 12 permutations consistent 
with 1233 etc. 


THE UNBIASED ESTIMATE OF VARIANCE 


ОО OO eo eo 


© (000/00t»090»/0:c»» 
o 0000009 


900000 


MEAN (м мА EG) = 3 E? vam 0-м sy 
OO MC uM dl ees 
Variance of Unit Sample Distribution- 
OOO + * wv 0347 Fy bgp og 
OOO : + e nee з 
Wotionce of Mean of 3-fold Somples: 
OOO + Fe ee F vapp aii 
QOO : s: 9 e d 
Mean of Variance of 3~fold Sample 
BOC) + F e 3-429 seo monn: YD =F 
QOO + + ee spa à 
Me УУ) 
DOC) s я ERD apeo о ier 
TOTAL: x E: 20 g 2 
MEAN Е): 2 i $ + i 
MEM) EMO [2:405] MOL) €,62) 


Fic, 98, The Unbiased Estimate of Variance—the complete sampling distribution of the 3-fold toss of the die of 
Fig. 67 in Vol. I, exhibiting the relation between the mean variance of the score distribution within each sample and 
the variance of the u.s.d., i.e. the score distribution of all possible samples pooled in appropriate proportions. 
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TABLE 2 

Samples Mra | М, | Еда) 
1 1 1 1 1 1 0 0 
ЕЕЕ ЕВЕ 2 p + 
1 2 1 + E 2 i + 
а ENS 2 i + 
1 2 2 + af 3 # E 
2 1 2 H " 3 i E 
Ж УЕ + 1% 3 + + 
2 2 2 2 4 4 0 0 
Total | 12 | & 20 1 + 
Men| # i + + i 


M, ЕФМ?.) E, E(x) M(V,,)—E(V,) Ез) 
V, —-$—üy»-i: УМ) = $- Ф = 


TABLE 3 
Sample Structure 
ип 112 113 1122 1123 1133 1222 1223 1233 1333 2222 2223 2233 2333 3333 Totals 
48 24 4 ° ° 0 о 0° 256 
24 24 0° 64 96 48 8 LJ 512 
24 48 12 0° 32 48 24 4 256 
96 96 16 64 128 96 32 4 1024 
H ЖЕ s: 1$ 4 * а 2 | M, EM, 
* ж ot 8 5 oio 1 lt D 
н Hoi s bote 9 H M(V,.4) 
H но 1 Е EE 5 0 i Eje) 


Vu = GM — 25 + 340-21 A — 2)? = 4. 


With a lay-out of either type we can visualise the meaning of (iv) above in a new way, since 
M(V,.,) = E(V,.. We may write 
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We can thus define a sample statistic whose expected value is the true variance of the universe 
by the relations 


and ELD = У, . " . (vi) 


It is customary to speak of ғ so defined as the unbiased estimate of the u.s.d. variance, i.e. 
variance of the distribution of individual scores in the parent universe. 

The foregoing analysis involves classification of the sample by one criterion. We can introduce 
a second criterion of classification, if we toss more than one die. We then have to represent 
each class of samples by a two-dimensional lay-out, and the entire assemblage of the random 
sample distribution as a 3-dimensional grid of which each /ayer is a sample. The number 
of layers having one and the same set of scores in corresponding cells must then tally with the 
relative frequency of the sample so defined. 

Fig. 99 shows the build up of the grid in accordance with the chessboard principle for the 
2-fold toss of each of 2 unbiased pennies. If we assume that each toss is a fair toss, the dis- 
tribution of scores in each pillar, each row-slab and each column-slab will accord with one and the 


cow в (2 TOSSES) CON в (HEAD SCORES) 


0000 0000 ОО O.1 ТОК 
1 


COIN A (HEAD SCORES) 


ю 
H 
a 
7 
H 
H 
4 
3 
2 
i 


A UNIVERSE OF SAMPLES 


Fic. 99. The results of 2 tosses of an unbiased coin set out as a 2-way classification, the criteria being identity 
of coin and order of toss. All possible samples are shown in their correct proportions. 
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Two-fold Toss of Coin B, with 
и bios 


in favour of Heads 


COIN B 


H 
С 
©,©|©,0|0,0|©,© 


Fic. 100. Chessboard lay-out for 2-fold toss of a biased coin (2:1 in favour of heads) exhibiting results for the 
same 2 criteria of classification as in Fig. 99. 


same unit sample distribution, i.e. that of individual scores in the entire 3-dimensional universe 
of samples. We then say that the universe is homogeneous for both criteria of classification. ‘The 
pillar-mean scores of this example will thus be 

Coin 


In this case, each of 16 possible samples of different structure occurs with equal frequency. 
If one coin has a bias the number of different sample classes is still sixteen ; but their frequencies 
are not all equal. Fig. 100 shows each stage of the lay-out for the 2-fold toss of two coins, one of 
which (A) has no bias, while the other (B) falls head upwards twice as often as tails. Thus the 
definitive binomials of the unit sample distributions are respectively (3 + 4)! and (3 + 8). 

Here the entries of the same column refer to the same coin, entries of the same row to the 
same toss-order. Each column-slab in the universe of Fig. 101 thus constitutes a homogeneous 
sub-universe in the sense that the distribution of individual scores within pillars of one and 
the same column-slab are identical, but the distributions of scores in different column-slabs 
are not identical. The within-pillar distributions of the same row are not identical ; but the 
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SAMPLE DISTRIBUTION 
for 2-fold Toss of unbiased Coin A 
and 2-fold Toss of biassed (2:1) Coin B 


CON B 


шз — 


Fic. 101. The 3-dimensional universe of all samples shown in Fig. 100. 


row-slab distributions are identical with one another and therefore with that of the universe 
a whole. The pillar-mean scores will be 


Coin 
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Of this set-up, we say that the universe is homogeneous only for the row-criterion of classi- 
fication. Thus we can define a universe as homogeneous w.r.t. either or both of two criteria 
of classification, if we conceive it as a complete random distribution of rc-fold samples classified 
with respect to one (column) criterion involving c classes and a second (row) criterion involving 
r classes. So conceived our criteria of homogeneity are as in Table 4. 


TABLE 4 


DISTRIBUTION OF INDIVIDUAL SCORES IN 


HOMOGENEOUS 
WITH RESPECT 
S Pillars within Pillars within 
TO: Row-Slabs Column-Slabs ode т 
Both criteria as for whole grid as for whole grid as for whole grid as for whole grid 
Row-criterion only as for whole grid different different as for column-slab 
Column-criterion only different as for whole grid as for row-slab different 


We can still visualise the distribution of samples from a universe classified w.r.t. 3 criteria, 
if we conceive each sample as a 3-dimensional grid constituting a stratum and the universe of 
samples as a vertical succession of such strata. As a simple illustration we may consider the 
result of the two-fold toss of 4 coins : 

A French silver C American silver 
B French copper D American copper 


We have now 3 criteria of classification : (a) toss-order ; (b) metal; (с) nationality ; and we are 
entitled to ask whether the universe is homogeneous with reference to any or all, i.e. whether 
each toss is a fair toss, whether French coins have the same bias (if any) as American coins or 
whether copper coins have the same bias (if any) as silver coins. We may lay out in one layer 
of the sample stratum (Fig. 102) French coins by toss-order and metal as our criteria and in the 
other American coins by toss-order and metal in corresponding dimensions. In this case each 
stratum consists of 2 layers each of 2 columns and 2 rows. If there are л classes with respect 
to the layer-to-layer criterion of classification, the stratum will contain ncr cells, and the universe 
grid of s-strata will consist of ners cells. 

Here, as elsewhere, we use the term sample frequency (y,) for the proportionate contribution of a 
sample class to the entire distribution of such classes, so that the sum of all frequencies is unity. When 
we speak of relative frequencies (f,) we signify corresponding whole numbers in the same ratio and define 
s as their sum, so that y, = (f, + s). If the grid representative of a complete sample distribution con- 
sists of s layers (or strata, as the case may be), we assume that there are f, layers (or strata) exhibiting 
the lay-out of a particular sample structure of relative frequency /,. We may then define the operation 
of taking the mean of a sample parameter (U,) alternatively as 

kas 


à». V= HU) = 7 È Od. 


If we care to regard the theoretical sampling distribution as continuous, we must interpret the summation 
as an integral. This does not affect the ensuing argument. 


1808 CRITERIA OF HOMOGENEITY 


We have already defined in general terms what we mean by criteria of homogeneity in this con- 
text, viz. the definition of sample parameters whose expected values should be consistent, In 
what follows, we shall first explore the issue vis-d-vis 2 criteria of classification. 
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With this end in view we conceive our sample as a layer of r rows and c columns in a 
3-dimensional grid of s layers like that of Fig. 85. Our assumption will be that the frequency of 
layers with a given structure tallies with the frequency of the random distribution of correspond- 
ing zc-fold samples. We shall denote as хуу the score of the cell in column 1, row j and layer 
k, indicating by the convention of 11.05 whether a parameter of the grid refers to a sample, to 
a column within a sample or a row within a sample, as below 


Mean Variance within No. of cells 
Row . . s Ми» Vair © 
Column : x. Маса b r 
Sample (layer) » M... Fela TC 


For the true variance of the putatively homogeneous universe we shall write o? = V,. The 
evaluation of unbiased estimates of с? based on different parameters of the sample is simple in 
the notation of 11.05, if we recall the fact that the operations denoted by E,, E, and E, are such 
as we can perform in any order. ‘Thus we may write 
E,. M(V z. es) = E, EKV a. c3) = E, EV z. а); 
E,. M(V s. +s) = Es. E (Vc. rs) = Ey. E(Ve. rs). 
Now the sample variances И,. с, V,.,, and Va., respectively refer to samples of 7, of 
cand of rescores. In accordance with the rule we have recalled in 13.02, we may therefore write 
r—1 
r 


=; EV.) Ct ЕДУ.) = de 


EV a. es) = 


Since these expressions involve only the numbers r and c (which are fixed for all the samples 
of r rows and c columns) and о? which is a constant of the universe 


r—i 


E,.E(V,..) = а = E,. M(V z. а); 


r 


Е,.ЕДУ,.„) = o? = Е,. M(V,. pa). 


Since any systematic sources of variation associated with the row or column criteria of 
classification will respectively have the effect of changing the variance of the distribution of 
the row-means or that of the column-means, we should expect that estimates of o? derived there- 
from would be consistent only if the universe is homogeneous. Accordingly, we first seek to 
express o? in terms of the expected values of V(M,.,,) and V(M,..,. Ву recourse to the 
fundamental tautology of the grid 

ЕИ... — М(У,. „)] = Е,. V(M;. rs), 
<. E, . V(Ma. „) = ELV e.) — Е,. M(V n. 1s) 
rec ET 


= ———gf os 
TC e 


i: E, VMMa.) = 1 Posez s MES 
Similarly we derive 
Evan j=. ol CREE 
TC 


ASSUMPTIONS UNDERLYING ANALYSIS AND SYNTHESIS OF VARIANCE 545 


From (i) and (ii) we can therefore define two sample statistics by the relations 


TC 


Els) = 9° and у= VM... . . . . (i) 
Е) =o ad = ИМ.) . . 0. 0) 


5,— S 
r—1 


у= (у) 
We now have two estimates of о? based on variation in alternative dimensions of the grid. 
We can obtain one which takes into account variation in both dimensions from V’,, , and another, 
which will later prove to have a special significance, if we recall the parameter (У„) defined in 
accordance with (viii) and (ix) of 11.05 : 
V, = V,.,— V(M..») — V(M..o). 


The interest of this statistic has emerged in our discussion of the Handicap Score-grid Model 
of Chapter 10 (Vol. I). We then saw that the corresponding parameter of the universe is equal 
to: (a) the total variance in the absence of a row or column source of variation ; (b) the residual 
component of variance, if strictly additive independent row and column sources contribute to 
total variation. From the above, we have 


ЕЁ.) = E,. MV...) + Es. М(У,.„) — ЕУ...) 
a(S Je; 


r c тс 
— э 2 
ESAE (r= 1Xc — По? 
re 
We can now define a statistic whose expected value is the true variance of o* by the relations 
2 тс E 
Eos wd = ре 0 0 00 


In the notation of the computing schema defined Бу (x)-(xiv) of 11.05, we may write this as 


S,--S—S,— 5, x 
ж кс с сет en 


The statistic 52 takes into account variation in both dimensions of the sample grid, and our 
criterion of homogeneity in both dimensions is that the numerical values of neither s? nor s? 
differ significantly from that of 52. We may lay-out the three estimates as below : 


tae jor Divisors Unbiased 
Sums of Squares > > (....) | (degrees of Estimate 
{=1 j=1 freedom) of о? 
T 
re. V(Mz. n) =S,- S r-1 E] 
re. V(Mz, e) = $,— S e-1 E] 


ré. V em 8+ 8—8,—8, (r— 1Xe— 1) 3 
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"The following numerical example referable to a 3 by 3 grid illustrates the computation. 


(a) (b) 
Scores Total | Т} 
3 1 8- 12 144 
9 Ж 5 21 441 
6 4 2 12 144 
Total| 18 12 15 45 | 729 
T}| 324 144 225 | 693 


5, = 285; S = 30452) = 225; S, = $$ = 231; 
S, = 23? = 243, 


= Sum of Squares AT > 
Estimate based on see (x)-(xiv) in 11.05 Divisor Estimate 


Rows 243 — 225 =18 2 9 

Columns 231 — 225 = 6 2 3 

Residual 285 + 225 — 243 — 231 = 36 4 9 
Total 60 


When our concern is with 3 criteria of classification, the number of possibilities we may wish 
to explore involve not only the existence of an additional systematic source of variation but every 
possible interaction between all three of them. Which statistic we chose to compare with the 
residual as a criterion of homogeneity or non-interaction is an issue which will raise less difficulty 
for the beginner if we defer it till we have examined the balance sheet of 13.06. In the deriva- 
tion of (i) above we have used the relation 


ДЕ.) 


at, 


TC 


Accordingly, we may define a statistic which takes into account variation in both dimensions of 
the grid by 
TC 


|o re—1 


^ Va.. and ЕД2) =. 

Some readers may well ask : why should we not prefer s? so defined in preference to s? as defined 
by (vi) as our yard-stick of comparison when the end in view is tc decide whether the column- 
means or row means yield an adequate estimate of variation in both dimensions of the grid ? 
The fact is that we do—in a roundabout way—when we test the significance of a correlation 
ratio as in 16.08 below. Indeed, the issue is not referable to the arbitrament of common sense. 
In this context, a sufficient answer is that we shall require s? for a different use, if the end in view 
is to assess the significance of differences between column- or row-means, when the universe is 
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not homogeneous in both dimensions; but we may here anticipate another one. We shall 
later see that the ratio of s? or of 52 to s? is а Type VI distribution, whereas that of either to sẹ, 
defined as above, is a Type I distribution. It happens that there are more convenient tables 
based on the former available for assessing the consistency of different estimates. 


1304 A BALANCE SHEET FOR Two CRITERIA 


As stated, we shall not at this stage examine the rationale of a test for the consistency of 
estimates of the variance of a putatively homogeneous universe. If the result of such a test, 
as explained in 16.05, leads us to reject the null hypothesis, we may then consider the question : 
what fractions of total variance in the universe of sampling are respectively attributable to 
agencies associated with the several criteria of classification and to residual sources ? 

'The credentials of any such balance sheet depend on a new set of assumptions, which we 
may specify under three headings : 

(a) causal, inasmuch as they refer to which effects of different components of variation con- 

tribute to a particular score value ; 

(b) statistical, inasmuch as they refer to the distribution of the score components singly or 

jointly ; 

(c) operational, inasmuch as they depend on the framework of repetition which the 

experimenter has in mind. 

To clarify this threefold distinction, it will be helpful to cite a model experiment in which 
nature and nurture appear as the two criteria of classification. On six consecutive occasions 
with a 4-hour interval between any one and its predecessor or successor, a laboratory worker 
makes one determination of the blood calcium level of each of five rabbits, using the same five 
throughout. If we set out the 30 observations (scores) in a 5 (columns) by 6 (rows) table, we 
have to deal with three putative sources of variation : 


(i) a rhythm of variation within the 24-hour period in one and the same animal, its effect 
being therefore such as to increase variation of the row means ; 
(ii) systematic differences of the absolute level between animals at one and the same time, 
their effect being such as to increase variation of the column-means ; 
(iii) random errors of measurement sufficient to ensure cell to cell variation in the absence 
of either of the systematic components, and hence also some variation in row- and 
column-means. 


It is admissible to conceive that each cell score in this set-up has three strictly additive 
components, which we shall refer to respectively as the residual, the column factor and 
the row factor. This constitutes a causal assumption. Ex hypothesi, the row factor varies from 
row to row, being constant from column to column and the column factor varies from column to 
column being constant from row to row within the sample ; but we are free to postulate random 
distribution of the residual from cell to cell in each dimension of the grid. This is a statistical 
assumption, ‘as is the postulate that there is zero covariance between the residual and the other 
two components.* 

Neither the assumption of additivity nor that of zero covariance is necessarily true of any 
particular situation. They are attractive from a statistical viewpoint, because the variance of 
the distribution of the sum of n variates is the sum of the variance of each, if the covariances are zero. 
‘This circumstance makes it possible to express the total variance of a system as a sum of additive 
components ; and that indeed is what we mean when we speak of a balance sheet of variance. 


* The lay-out implies zero covariance of the row and column factors if their effects are strictly additive. 


5 


548 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


Having adopted these postulates with more or less plausibility we are not yet ready to pro- 
ceed. For we have still to make an operational assumption, without which no unique solution 
is possible. Until we have decided within what framework of reference we choose to regard 
our experiment as a random sample, we are not in a position to undertake our analysis. In 
effect, this signifies that we have to find an answer to the question: in what way do we propose 
to repeat the experiment ? One may repeat the experiment last cited in four ways : 


(i) by making 7 different determinations on each animal at one and the same time ; 
(ii) by making observations at corresponding times in the course of the 24-hour period on 
the same set of rabbits on successive days ; 
(iii) by making corresponding observations on more than one set of rabbits at identical 
times on one and the same day ; 
(iv) by making corresponding observations on different sets of rabbits on successive days. 


Evidently, the only use of an exhaustive balance sheet exhibiting components of variance 
is to prescribe what is likely to happen, if one does the same thing again. Evidently also, the 
sources of variation are not the same in the four ways which one might choose to regard as doing 
the same thing again in this context. The first implies that row and column factors remain 
constant throughout. ‘The second and third respectively imply that the row factor alone or the 
column factor alone vary from one trial to another. The last signifies that both row and column 
factors vary. It leaves us free to postulate that they vary from sample to sample at random, 
and hence to invoke with more or less propriety a distribution law consonant with the possibility 
of assigning confidence limits to the entries of our balance sheet. 


SAMPLE - STRATUM LAYOUT 


of 2-fold toss of each Copper j=1 
3 French Hh = 1 
2 being Americon а 2 French: 
one coin of 


each nationality silver, Americon h=2 


the other copper. 


i21 i=2 
Toss 
Fic. 102, Visualisation of a sample stratum for a lay-out involving 3 criteria of classification. 


On this account, Churchill Eisenhart (op. cit.), who distinguishes between (i) and (iv) above 
as Model I and Model II situations, emphasises the distinction between them with particular 
reference to : (a) precautions taken to ensure random sampling in the design of the experiment ; 
(b) whether the end in view is merely to assess the role of error variance or to effect a complete 
partition of the components of variation. Lee Crump (ор. cit.), on the other hand, is more explicit 
about what we here regard to be the focal issue, viz. the operational intention. 
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"The following assumptions are common to the treatment of the problem in accordance with 
the postulates of either Model I or Model П: 


(i) Three strictly additive components contribute to the sample cell-score x,;,, in 
accordance with the following equation in which e;;., is the residual, F,.,,the 
column factor and F;, ,, the row factor : 


жа = 064... Fea t+ Fy. ce 


(ii) The covariance of any pair of components in (i.a) is zero, i.e. 
Cov (ei. Fi. es) = Cov (eis.s, Fi. rs) = Cov (Fi. es Fi. rs) = 0. 


Sr je 
5. J9 


Column Factor Fic constant within column of somple (loyer) 
Ond within column-sob of universe (3-dimensional grid) 


Row Factor Fj, constant within row of sample (layer) Row Factor fi 
‘ond within row-sob of universe (3-dimensiono! grid) 


Fic. 103, Two sets of assumptions concerning additive score components. 


(iii) If o? = V, is the variance of the distribution of the total score хуу in the universe, 
and оў, оу, o; are the corresponding variances of the distributions of the score com- 
ponents in () it follows that 


c? — + o? + o. 


fe 1 0 

(iv) The residual component е, varies from cell to cell within the row and within the 
column of the sample random-wise, so that the distribution of residual score com- 
ponents is the same in all pillars of the 3-dimensional grid of the complete random 
sample distribution. 

(v) Within the same layer of the 3-dimensional grid F,.,, varies from cell to cell only 
within the row, being fixed for the column, and F}. ,, varies from cell to cell only 
within the column, being fixed within the row. 

(vi) Accordingly, the distribution of the column factor in the sample as a whole is identical 
with its row distribution, all rows being alike with reference thereto; and the 
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3 x 3 CLASS UNIVERSE STRATIFIED IN 2 DIMENSIONS 
by addition of fixed Row ond Column increments within the layer 


Column Foctor Fie constant within colum» of sample (loyer) 
‘end within column-siob of universe (3- dimensionat grid) 


Row Factor Fj, constant within row of sample (loyer) 
‘ond within row=slob of universe (3- dimensional grid) column - siad 


i 
i 


-wob distributions: 
One another ond with that of whok grid 


Fic. 104. 'ТҺе 3-dimensional universe of sampling for the two model situations of Fig. 103. 


distribution of the row factor in the sample as a whole is identical with its column 
distribution, all columns being in this respect alike. 


The postulates peculiar to Model I are 

(vii) Fi. es is fixed for all cells within the same column-slab as well as for all cells within 
the same column of the same layer, and F}. ,, is fixed for all cells within the same 
row-slab as well as for all cells of the same row within the same layer. 

(viii) Hence the variance of the row factors within a column as within a layer is o7 and the 
variance of the column factors within a row as within a layer is ог. 

Contrariwise, the postulates of Model II will be that F;. cs and F;. ,, vary at random from 

layer to layer in the sense that 

(ix) each row-slab and each pillar therein accommodates a complete random distribution 
of column factors identical with the distribution of column factors in the 3-dimensional 
grid as a whole, whence also in virtue of (v) and (vi) identical with the distribution 
of column factors in the column-slab ; 

(x) each column-slab and each pillar therein accommodates a complete random distribu- 
tion of row factors identical with the distribution of column factors in the whole 
3-dimensional grid, whence likewise in virtue of (v) and (vi) identical with the row- 
slab distribution of row factors. 

In what follows we shall first explore the consequences of Model II. The only new con- 
sideration of moment arising from the foregoing definitions is that the whole re-fold sample of 
x-scores which supplies us with an rc-fold sample of e-scores is a c-fold sample of row factors 
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on account of the identity of the rows with respect to the latter and an r-fold sample of column 
factors on account of the identity of the columns with respect thereto. We may express this 
otherwise by saying that the sample as a whole furnishes us with no information about the 
column factors other than what we may infer from the composition of any one of the rows alone, 
and no information about the row factors other than what we may infer from any one of the 


columns equally. 


In accordance with Model II postulates, we shall need symbols for the variance of the score 


components as below : 


Residual Row factor Column factor 
Whole sample (layer) -~ . V,., И... = Veo И... Ио. та 
Within-row . : . . LoT Ё,.„=0 Va. rs 
Within-column . З 5 Vice EL Vascos = 0 
From what has been said, the expected values of the above are 
тс — 1 r —1 c—1 
EWV.. )= E куу, у= EWV.) = 8: 
= —1 
EW.. n) = Ea D E(V,. n) = i 
r—1 r—1 
EV.. а) = се) E(V,. 4) = —- or 0. 


We now recall the procedure of which the following is a pattern : 
—1 
E, M(V, et) = Es -EAV,. e) = E, EMV ss) = —;—% 

If the components have zero covariance 

Vars m Vea Vea Ves; 

И. Verret Vo. nas 

Va. es Vea Ve. cx 
Whence we derive : 

=й, т—1 c—1 


EV...) mE uer = 


E,.M(V.. 


Е,.М(Ү,. 


ТЕ V, has the same meaning as іп 13.03 : 
ЕДУ) = E,. M(V,. „) + Es. MV...) — ЕУ...) 
„(1+ -h 
E т тс 


= 06-1), 
тс 


EV.) = 
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Accordingly, we may define a statistic by the relations 
Ej(s$)-—o2 and s 


TC 
(r—1€-1) 
In the notation of (x)-(xiv) in 11.05 

2_S+S—S,—S, 


Sp = 1 * A Я . (ii) 


(r — 1)(с — 1) 


p : E „+ (0) 


Similarly we have 
Е,.Ү(М..„) = ЕУ...) — Ey. WV...) 
r—1 cir r—1 r—1 


ea eere 


TC c 
Accordingly, we define a statistic by the relations 
EA) =o +r and $=- = 1/04...) = = Gv) 


For purposes of computation in accordance with (x)-(xiv) of 11.05 
ac 5.— 5 


с— 1 


(v) 


In the same way may we derive the statistic defined by 


ЕДӘ) =+ co? and $= 


TC 
r—1 


VM... + . (98) 


In the sum of the squares notation for computation : 
S,—58 = 
$= s ; c : В 7 . (vii) 


We may thus set out the Model II balance sheet as follows : 


Sums of Squares 


see (x)-(xiv) of 11.05 Divisors Expected Value | 


re. VM, e) = S.— S c-1 S 
re .V(M,z. n) = S,— S r—1 of + 
r.Vs=S+S—S.—S, | (r—1(c—1) " 


By eliminating o? from the first two items we obtain 


Component Unbiased Estimate 
e ELCHE _,. 
d (r—1(c— 1) ' rr— 1(c— 1)’ 
e S,—S $,—8, 


10061) er- 
акр 
(r — 1)(с — 1) 
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Let us now examine the consequences of assuming that the column factor is constant from 
sample to sample, i.e. 
ЕСУ, ..) = o; = ELV.. rs) 
We then obtain 


—1 —1 
ву.) = d — e d 
к. Lh + 8 

—1 
ЕДУ...) = + o 


This does not affect the derivation of the expected value (:2) of V, as defined by (ii) and (iii), 
nor that of s? as defined by (vi) and (ун); but 


By. V, a) = El + + a ta = tt + ots 
TC y T F re 
ELD =t eee Wii 


Similarly, it will not affect the meaning of s? or 52 if we postulate that the row factor remains 
constant from sample to sample; but we then derive 


ЕД) =o? +o? ас) 


If both systematic components remain fixed from sample to sample both (viii) and (ix) 
hold good ; and our balance sheet (Model I) is as below : 


Sums of Squares Divisors Expected value 
rc. Fie.) = S. 8 e-1 ob + oot 
re. VM.) = 5, — 5 koa ata 
re. V, = 5,+ 5 – 5, – 5, (= 0(с = 0 9% 


Alternatively, we may put it in the form : 
Component Unbiased Estimate 
Cac 559. 


e dr—31) * rdr—1y 
S,—S8 , $,—8, 
2 т с— Se. 
eb DR c— 1) 
P Ko E 


ож ==, 


554 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


13.05 THE ADDITIVE PRINCIPLE 


In seeking a rationale for the construction of a balance sheet of variation we have postulated a 
universe of scores with 3 additive components, a column factor, a row factor and a residual. On 
the assumption that there is zero covariance between any pair of them, the true variance of the 
composite score in the universe of choice is the sum of the variances of the three components, 
ie. o? = 02 + о? + о. "Thus o; stands for what the total variance would be if there were no 
source of systematic variation associated with the row and column criteria of classification. 
The tidiness of this relation has a deceptive air of finality. So it is important that the student 
should understand what factual assumptions entitle us to construct a balance sheet in accordance 
with the algebraic postulates of 13.04. 

From the factual viewpoint, the pivotal postulate is that the effects of both row and column 
factors are strictly additive. "This signifies that effects of sources of variation associated with 
the two-class systems are such as to change the mean value of the row or column score distribution 
without changing its form or scale. Now it is easy to imagine many other ways in which inter- 
class variation might arise. In much experimental work, change of scale or dispersion without 
change of mean in virtue of the competence of the worker is just as likely an assumption, perhaps 
moreso. Hence the attractiveness of the additive postulate resides less in its relevance to external 
nature than in its convenience to the mathematician. Of this, as of other assumptions com- 
monly made in relation to the same class of procedure, we may cite the comment of Churchill 
Eisenhart (1947) : “ the only motivation that has been given is the more general nature of the 
inferences that may be drawn . . . when it is satisfied”. 

In any real situation, it therefore behoves us to ask whether the additive postulate is indeed 
plausible ; and it is conspicuously open to question in the field of earliest and most extensive 
applications of variance analysis. Here again the remarks of Churchill Eisenhart (op. cit.) are 
explicit and salutary : 

Hence, when additivity does not prevail we say that there are interactions between row and column 
factors. Thus, in the case of varieties and treatments . . . additivity implies that, under the 
general experimental conditions of the test, the true mean yield of one variety is greater (or less) 
than the true mean yield of another variety by an amount—an additive constant, not a multiplier— 
that is the same for each of the treatments concerned, and, conversely, the true mean yield with 
one treatment is greater (or less) than the true mean yield with another treatment by an amount 
which does not depend upon the variety concerned ; which is exactly what is meant when we say 
that there are no “ interactions ” between varietal and treatment effects. 

Mathematicians who are not conversant with the vagaries of gene exhibition and biologists 
who are not at home with the technical intricacies of the thesis expounded by the writer of the 
remarks cited above will not regard it as unprofitable to pinpoint what is of cardinal importance 
to the present discussion by reference to a naturalistic illustration. Our supposition is that we 
record in 3 different environments the size (yield) attained at a given age by individuals of two 
species of flowering plants, one (A) being calciphil and the other (B) being calciphobe. ‘The 
three environments (treatments) are then the native soil (untreated), native soil with addition of a 
neutral calcium salt and native soil treated with a neutral potassium salt. То drive home the 
point Churchill Eisenhart makes in his reference to treatment (nurture), variety (nature) and 
yield (phenotype), we may disregard the residual component of the cell-score (yield) arising 
from random errors of measurement and uncontrolled subsidiary difference w.r.t. environment. 
If we denote the cell-score in the absence of residual error so defined as u,;, the column (species) 
factors respectively by F, and F,, and the row (treatment) factors as Fj, F, and Е, our set-up 
as prescribed by the additive postulate is 
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Species 4 Species B 

greri un = (Fa + Е) us = (Fy + Fi) 
Eres | ша = (Fa + Fi) шз = (Fy + Fi) 
Eros | ua = (Fa + Fa) из = (F, + Fs) 


The implications of this become more obvious, if we set the result out thus : 


Species A Species B 
Effect of Ca . . (ша — иц) = (Fe — Ез) = (изз — и) 
EffectofK . + (ша tin) = (Fs — Fy) = (из — и») 


The above schema signifies that a fixed excess of Ca increases the size of B and A by an equal 
amount, a statement which is inconsistent with our own initial assumption that the two species 
are respectively calciphobe and calciphil. Likewise the additive postulate signifies in this 
context that B and A react by equal responses to a fixed increment of K, an assertion inconsistent 
with general experience of ionic antagonisms in the biological domain. On the contrary, we 
should expect a calciphil species, which reacts by increased yield to increase of Ca soil content, 
to react by diminished yield to excess of K, and a calciphobe species which reacts by diminished 
yield to increase of the Ca soil content, to react by increased yield to excess of K. 

From the field of interspecific variation, it would be possible to cite numerous examples 
of comparable situations, but the writer has sufficiently emphasised their occurrence within the 
domain of intraspecific variation. More recently Haldane * has classified known types of 
interaction, i.e. departure from the assumption of additivity, by recourse to experimental data. 
It is indeed open to question whether there exists any nature-nurture situation about which we 
can make any such assumptions with confidence in the absence of corroboration, or whether it 
will often happen that such an assumption is plausible. What is certain, as illustrated by the 
foregoing example, is likewise embodied in the adage that one man’s meat is another man’s poison. 
Many situations arise in which stimulus X increases response of genotype A and inhibits that of 
genotype B, while stimulus Y decreases response of genotype A and augments that of genotype 
B. That it is necessary to remind the biologist familiar with his materials that the additive 
postulate may therefore be grossly inapplicable to a set-up in which the two criteria classification 
are nature and nurture, is because relatively few biologists who invoke the technique under dis- 
cussion with a view to the construction of a balance sheet exhibiting the respective contributions 
of nature and nurture variables realise that the additive postulate is in fact the keystone of the 
entire edifice. . 

Accordingly, we may thus sum up the outcome of our enquiry at this stage : 

(1) The possibility of constructing a true bill which sets out what fractions of total population 
variance are respectively attributable to one or other source of variation specified by 
the class criteria and to residual errors of observation or other uncontrolled circumstances 
presupposes the truth of the postulate that the components are additive ; 

(2) From inspection of the data of a single small-scale experiment it is never possible to 
infer with certainty that this postulate is valid, and there will arise many situations in 
which it is grossly incorrect. 


* ]. B. S. Haldane (1946), ** The Interaction of Nature and Nurture”. Ann. Eugen. 13, 197. 
5% 
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"These considerations prompt us to ask: is it possible to justify the additive postulate by 
recourse to observation, and if so, how ? To answer this, we shall suppose that the joint contribu- 
tion of F,.,, and F;,,, to the score value exceeds or falls short of their sum by an amount 
Fis.. which varies from cell to cell, i.e. : 


u.s = 064. ab Fe. cs t+ Fy. cet Fas. 


Evidently the expected value of s? in 13.04 will not be o? unless F;;. , = 0, and the design of 
an experiment involving single score values for each cell in a 2-way lay-out provides no occasion 
for distinguishing between two components which both vary from cell to cell. On the other 
hand, their effects are distinguishable if we resort to n-fold replication, i.e. n-fold repetition of 
each observation without changing the row and column sources of variation, In such an experi- 
mental design, we conceive our sample as a stratum of п layers. The residuals vary random-wise 
from cell to cell within a layer and from layer to layer within a pillar. If the replication is 
faithful, the component F;;., varies from cell to cell within a layer but not within a pillar. 
Accordingly, we can ask whether the measures of cell-to-cell variation within a pillar and 
within a stratum are consistent, i.e. if F;;., = 0, in a set-up for З criteria of classification 
involving replication as the new one. 

We shall examine this issue in 13.06. Here it suffices to point out that the construction of 
a balance sheet for an experiment involving replication is valid only if: (a) the analysis fails 
to disclose a new component of variation ; (b) we have other reasons for assuming that the 
3 systematic components conform to the postulates of additivity and zero covariance. If the 
results of identical replication do not confirm the assumption that the postulate is valid, the 
inclusion of a separate component of interaction as defined by Churchill Eisenhart in the 
balance sheet of causality merely serves to announce that the procedure for constructing it is 
defective, hence also that it is not a true bill. 

Before we examine the credentials of the balance sheet for a replication experiment, it is 
fitting to examine what we may rightly infer, if there is indeed good reason to believe that the 
additive principle holds good. We may then interpret our balance sheet as 


(i) a recipe for assigning to what errors mean measurements are subject when we exclude 
one or other source of variation ; 

(ii) an overall picture of how much variability remains when we eliminate one or other 
Source. 


To clarify the meaning of (i), the illustrative experiment already cited will serve our purpose. 
At a given time of day, the data supply us with a mean figure for the blood calcium level of 
different rabbits. "This figure is therefore subject both to residual sampling error inherent in 
the method of measurement and to variation arising from the fact that different measurements 
refer to 5 different individuals. The unbiased estimate of the residual variance being 52, that of 
the mean of a 5-fold sample is 1(32) in virtue of (vii) in 7.03 of Vol. I. Alternatively, we may ask 
what would be the sampling variance for the mean of the series of 6 determinations on the same 
rabbit at different times of day or night, i.e. to what sampling variance our column means refer- 
able to the same rabbit are subject as the result of errors of measurement alone. In this case, 
our concern is with the mean of a 6-fold sample, and the required parameter is 4(s). In general, 
we may say that the mean row-scores and the mean column-scores are respectively subject to 
sampling variance of (s? + c) and (52 +r). In the writer's view, this is the most fruitful use of 
the procedures subsumed by the term analysis of variance, if only because it operates within 
the domain of estimation and therefore entails none of the debatable issues raised by recent 
controversy concerning decisions made within the framework of a unique null hypothesis. 
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An alternative conception of the sort of questions an accredited Balance Sheet of Variance 
may answer brings into focus an important difference between Model I and Model 11 of 13.04. 
As an assemblage of unbiased estimates of universe components of variance, the balance sheet 
would appear to be just as valid, if constructed on one or other assumption ; but we may wish 
to take the further step of placing confidence limits (see 16.03 below) around each of our estimates 
of the components. To do so, we must then invoke certain assumptions concerning the dis- 
tribution of the row and column factors. If we scrutinise our experimental data through the 
spectacles of Model 11, we are free to postulate with more or less justification a normal distribution 
of all three-score components in the universe asa whole. Thereafter the problem stated is purely 
mathematical, if we are entitled to regard the choice of sample as random. 

American writers on analysis of variance are not slow to stress the fact that random choice 
of column- or row-score components is often inconsistent with experimental design, as in the 
following remarks of Churchill Eisenhart : 


« 


. when an experimenter selects two or more treatments, or two or more varieties, for testing, 
he rarely, if ever, draws them at random from a population of possible treatments or varieties ; 
he selects those that he believes are most promising. Accordingly Model I is generally appropriate 
where treatment, or variety comparisons are involved. On the other hand, when an experimenter 
selects a sample of animals from a herd or a species, for a study of the effects of various treatments, 
he can insure that they are a random sample from the herd, by introducing randomization into 
the sampling procedure, for example, by using a table of random numbers. But he may consider 
such a sample to be a random sample from the species, only by making the assumption that the herd 
itself is a random sample from the species. In such a case, if several herds (from the same species) 
are involved, Model II would clearly be appropriate with respect to the variation among the animals 
from each of the respective herds, and might be appropriate with respect to the variation of the herds 
from one another." 


Lee Crump (1946) writes in the same vein : 


“ A Note of Warning. It must be remembered that in using the analysis of variance to estimate 
variance components, we have assumed the elements of the fundamental equation to be randomly 
selected from an infinite population. In an experiment where three widths of spacing some crop 
are purposely selected for trial, it is not reasonable to regard these widths as random samples from 
all possible widths. On the other hand the blocks in a field experiment may sometimes quite 
reasonably be regarded as a random sample of all such blocks. In sampling production from, say, 
three machines in a factory, where these machines constitute all the machines which the factory has 
or is likely to have, it is more reasonable to regard these machines as the whole of a finite population 
than to consider them as random samples from some infinite population. If the factory owner is 
sampling production with a view to purchasing more machines of the same type, the three machines 
may be appropriately regarded as samples of the infinite population made up of all machines of 
the same type." 


The more reasonable attitude to the three machines as the whole of a finite population is 
in fact a Model I view of the situation ; but the same example also brings into focus a semantic 
difficulty which besets justification of the alternative view. Indeed, the foregoing remarks of 
Churchill Eisenhart resolve only part of the difficulty of justifying the assumption that choice 
of classificatory variables is truly random. То be sure, we can choose cows of a particular herd at 
random, but if we do, our assessment legitimately refers only to that herd. То extend it justifiably 
to others of the same breed, we have to invoke the additional assumption that the range of intra- 
specific variation does not materially differ from herd to herd ; and to say that this assumption 
is itself unjustifiable deprives the assessment of public utility. In the nature of things, random 
choice of fertilisers of all possible chemicals curiosity or perversity may prompt the investigator 
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to add to the soil is a concept devoid of operational meaning ; and random choice of varieties 
within a species or of individuals within a variety is a concept we can justify without recourse 
to a God's eye view of the universe only as a description of a local set-up. For a truly random 
choice of rabbit varieties in Kent would not be a truly random choice of rabbits in Kentucky. 

Т. Н. Huxley remarked rightly that mathematics is a mill which cannot grind out ingredients 
other than those put into it. What is true of any statistical technique is therefore true of analysis 
of variance, and especially so. For statisticians of an earlier vintage never identified their terms 
of reference with so ambitious a title as the design of experiments. No statistical technique is an 
adequate substitute for common sense, alertness to the nature of the problem on the part of those 
who ought to be clear about it or for ingenuity directed to the removal of irrelevant variables in 
an experimental set-up. Indeed, it is well to remind ourselves that experimental science, in 
its assault on problems most successfully attacked by experimental methods to date, had advanced 
far towards its present stature without recourse to statistical principles of any sort. 

It is therefore necessary to insist that analysis of variance—like any other sort of statistical 
procedure—has a limited sphere of usefulness, especially because its legitimate uses are at present 
difficult to assess against a background of novel logical premises and, for most of us, unfamiliar 
mathematical procedures. In the situation we have used as an illustration of a 2-way classifica- 
tory set-up, our assumption has been that the investigator wishes to ascertain with as great 
economy as possible whether the blood calcium level of rabbits is or is not subject to a diurnal 
rhythm, i.e. a rise and fall within a 24-hour period. A balance sheet of variance which exhibits 
a significantly large component w.r.t. observations on different animals at different times of the 
day does not in fact answer the question last stated, such a result being consistent with a quite 
erratic fluctuation during a particular time interval such as 24 hours. In so far as the analysis 
bears on the problem stated, it is helpful because we can state to how much sampling variance our 
mean values for determination at different times of day are subject when we have eliminated 
all sources of individual variation. Hence we can see whether there is a consistent trend of 
our mean values throughout a 24-hour period without recourse to the more homely custom of 
repeated experiments of the same sort. In such a situation, the experimentalist is entitled to 
prefer the assurance of a consistent answer by recourse to laboratory experience of several days 
duration to the consolations of mathematics ; but there may well arise situations in the practice 
of industry or in sociological enquiry such as to commend a first approach which is more 
economical. 

With full recognition of the existence of situations in which an economical preview is 
indeed advantageous, it remains none the less true that no statistical procedure can rightly claim 
to provide a rationale for the design of experiments regardless of the end in view ; and a widely 
quoted illustration of the use of analysis of variance in particular is instructive as a warning 
against any such mechanical view of the value of statistical methods. In an early issue of 
Biometrika, Oswald Latter (1902) published the result of measuring the length of 1572 eggs of 
the cuckoo including 264 assignable to known foster parents of 6 different species. The odds 
are in fact about 100 : 1 that variation between nests of one or other type is not wholly explicable 
in terms of variation within nests. Since 1902 the same set of figures has passed from one 
textbook to another to illustrate one or other statistical technique fashionable at the time, latterly 
as an illustration of homogeneity tests w.r.t. a one-way classification involving unequal sample 
numbers as in 13.07. Indeed, the writer of a comparatively recent book on statistics for socio- 
logists introduces the topic with the complaint that “ it is a considerable jump from lengths 
of eggs in a cuckoo's nest . . . to sociological problems "'.* 


* Margaret Jarman Hagood : Statistics for Sociologists (1941). 
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The slip-up in the last sentence cited is pardonable, since sociologists are under no obligation 
to know that cuckoos do not have nests, unless current texts which trade in this exhibit disclose 
what is the end in view. On the other hand, it would be difficult to offer the naturalist an example 
of the use of statistics less calculated to inspire confidence. Similarities with respect both to 
colour and form between the cuckoo’s egg and those of the foster parent had long been a matter 
of comment and discussion among enthusiastic bird watchers and egg collectors. It was also 
well known that cuckoo eggs have a character peculiar to the locality where found, as discussed 
by Eugene Rey (1892) in his book Old and New information concerning the domestic economy of 
the Cuckoo. One may presume that Latter, himself a first-rate naturalist, knew all this when he 
chose the topic ; and one may be confident that he would have been able to throw further light 
on it if the hypnotic influence of Pearson's apotheosis of measurement as an end in itself had not 
enlisted his industry in an undertaking unlikely to add anything to what was already common- 
place among bird watchers. 

Indeed, it is scarcely too much to say that no author who uses Latter’s data as exemplary 
material has been able to convince the reader that the outcome of the ensuing arithmetical 
exploits has greatly advanced biological knowledge. It is also safe to say that it put at the 
disposal of those who have later clarified the enigma no helpful clue for their use or guidance. 
The facts, disclosed by E. P. Chance (The Truth about the Cuckoo, 1940) as we now know them, 
are the result of painstaking observations on the behaviour of individual cuckoos during the same 
and successive seasons. Briefly they are as follows. The same cuckoo returns in successive years 
to the same territory and almost invariably lays its eggs in the nest of a particular species, All 
the available evidence points to the conclusion that a cuckoo reared in a particular territory 
mates with another cuckoo reared in the same territory. In short, cuckoos are divisible into 
local sub-species each with its dominant foster-parent type, and selection has presumably 
ensured the survival of genotypes most fitted to lay eggs acceptable to the latter. 

Thus the truth about the cuckoo as it here concerns us is that a much-publicised statistical 
enquiry did not in fact draw attention to a new problem, and it did little if anything to clarify 
one which field naturalists already recognised as such. It is not easy to see how it would have 
been possible to elicit the relevant facts by methods other than intensive work of field observers, 
for the most part allergic to statistics of any sort. Statisticians who wish to enlist greater respect 
for the proper uses of statistics would therefore be wise to refrain from further comment on the 
cuckoo question when their aim is to show how statistics can help the field worker. 

One caveat it is still necessary to emphasise in this context concerns a class of judgments 
common to many situations involving multiple, as opposed to binary, classification. So long 
as our preoccupation is with only two classes the issue of homogeneity is straightforward. Either 
the statistical data referable to the two samples are indicative of a real difference or they are not. 
When we turn our attention to a system of more than 2 classes the assertion that there exists a 
real inter-class difference may signify at opposite extremes: (i) a graded effect distinguishing 
any one class from every other ; (ii) a clear-cut threshold response which may differentiate only 
one class from any other. We meet with clear-cut threshold effects very commonly in biological 
enquiry ; and we have no reason to disregard the possibility of doing so in social science. Where 
this is so, a multiple classification of the data may conceal or obscure a real difference which 
two-fold division at an appropriate level would bring sharply into focus. In the last resort, 
any statistical technique referable to a system of many classes will be more or less useful to 
the extent that the investigator exercises good judgment of his materials in the initial task of 
classifying them. 
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13.06 BALANCE SHEET FOR THREE CRITERIA 


An analysis involving three criteria of classification may be replicative or complete. "The first, 
sometimes referred to as incomplete 3-factor analysis, signifies that the third criterion of classifica- 
tion is simply repetition, as when we have n score values for each of rc cells in a lay-out involving 
two specific taxonomical categories. The second, referred to as complete three-factor analysis 
(without interaction), signifies that each of the л observations constitutes a member of a class, 
as in the coin model of Fig. 102. 

To clarify the replicative case we may imagine an experimental design of the following type. 
"The scores a, and b;; respectively refer to the red cell count of different blood samples from one 
and the same female rabbit at one and the same time of day : 


Rabbit I Rabbit II 


12 noon ац; bn ак; bey 


12 midnight | 2,5; b; аша ба 


In this set-up we have initially 2 specific criteria of classification : type of individual 
(columns) and time of day (rows). Precise repetition should lead to consistent estimates both of 
the error variance and that of the putatively additive row and column factors, if there is indeed 
zero covariance between the row and column factors, though a cell factor indistinguishable 
from the residual variance in a single trial would be separable in a repetition involving no new 
source of systematic variation. In that event, we should be able to distinguish from true error, 
which varies from cell to cell in any one experiment and from cell to corresponding cell in suc- 
cessive experiments, a component which varies only from cell to cell in any single experiment 
being constant in corresponding cells of successive experiments. "The words in italics are 
the operative phrase in the sentence above. — In addition to residual sources of variation arising 
from errors in connexion with each of the 8 counts involved, we may conceive a systematic 
source of error introduced by defective procedure, e.g. the use of a separate syringe needle for 
each rabbit at each time of day. We may then speak of a cell factor F;;. , which varies from 
cell to cell like the residual e,;,, of 13.04 but is constant within the cell. То represent this 
conception we need to label a third (within-cell) dimension (h = 1, 2 . . . n) of variation and 
our score components as follows : 


Column Factor ido os Row Factor . ue 
Cell Factor . E Fags Residual ‹ тәне 
We may then visualise the foregoing lay-out as below : 
а = 6m.. Fuss Fi. „+ Fire ац = em.a + Fare + Fai. et Fi. r 
bu = em.a + Fn.s + Fi „+ Fir b = еза. o Fnac Fa. ot Fi, es 
аз = ens. s + Fia + Fies t+ Fi. r аљ = ез. + Fasa + Fa. es + m 
bis = ens. o + Fiss + Foe Е. а bata Ent Fiat Pn | 


From a formal point of view, the outcome of the analysis will be the same whether 
we interpret F;., as: (a) an unsuspected independent systematic source of variation, 
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or (b) a covariance term which betokens interaction between row and column factors. 
If we conceive our sample as a 3-dimensional stratum of two layers, the systematic cell 
factor is a constant of the stratum-pillar, and it is important to notice that the order of the cell 
entries in this set-up is irrelevant. This is not so if we design a comparable experiment to throw 
light on the possibility that sex, breed and time of day are all significant sources of variation, as 
below : 


Аско Flemish 
12 пооп | Male 1 | Femalel| Male 2 | Female 2 
12 midnight | Male 1 | Femalel|  Male2 | Female 2 


L 


Here we are dealing with a third criterion of classification which is specific, and we may then 
postulate a factor (Fh .ns) definitive of the /ayer as in Fig. 102, and constant from layer to layer 
within the stratum of the 3-dimensional sample grid. If there is no interaction between the 
three specific factors, our system of score components is therefore : 


аң = Ane + Fi „+ Ру. „+ Е. п аза = баа. a + Fa. es + Fi. ys + Fon 
bu = Фа ‚+ Fives + Fir Fins ba = еп.. Fiat Fi. rat Fa. п 
ауа = епа. + Fi. es HFa. r + Fi аз = езз.. + Fa. es + Fi. re t+ Е. ne 
bis = en.e + Fiset Fa. cet Fin Bas = Casa co Fac Fan + Е.м 


If we postulate strict additivity our score equations will be 
(a) Incomplete 3-factor analysis (2 factors with replication) : 


Жз. а = ёз. БЕ. Firet Fuss - . . . (i) 
(b) Complete 3-factor analysis without interaction : 
Хмз.а = Oni a ЕЁ. Е. t Prins - . . . (ii) 


For the 3-dimensional sample of ncr score values the following table gives the number of 
sub-sample values of each component : 


У Column Row Layer Cell 
MGE Factor Factor F lap Factor 
Whole grid . . ncr c r n cer 
Column-slab . " nr 1 r n r 
Row-slab x : nc c 1 n c 
Layer . . : cr с r 1 cer 
Pillar . E Y n 1 1 n 1 


In conformity with our previous symbolism, we shall use c2, to signify the true variance of 
the cell-factor distribution and c; to signify the true variance of the layer-factor. We may then 
specify the expected values of the sample components as follows in accordance with the postulate 
of Model II in 13.04 : 
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Column Row Layer Cell 
Residual Factor Factor Factor Factor 
V... d 1 раи = «= 
о Е I a 0 "14 =i 
Vem 0. FIM Ste he р == 
Ve. res . : а 0 0 A 0 


We are entitled to interpret the 3-way complete analysis without interaction in terms of 


Model I, in which case оў, o? and o; respectively replace = Ta, 14 апі 1 


x оў in the 
foregoing table. We cannot interpret the expected value of the cell-factor variance within the 
column-slab or within the row-slab in terms of о}, if we adopt the same postulate. Accordingly, 
we shall restrict ourselves in what follows to the alternative assumption. 

Without examining the implications of Model II at this stage we shall now explore some 
of the consequences of the additive principle. Two statistics are common to both cases of 
3-factor analysis specified above, viz. the variances of the row- and column-means : 


E,. (М...) = ЕУ.) — EM(Ve. cs) 5 
Es. V(Mz. rs) = ЕДУ...) — EMV 2. r). 


Incomplete 3-factor Analysis : 


If we proceed in accordance with (i) on the assumption that our third source of variation is 
peculiar to the cell, our table gives 


Е4У,.) — EMV s.e) = Zo + 


er € r cer 


Tors 


5 Ey. УМ...) tec 2 аон. e 5 
Similarly 
r—1 = 1 r—1 А 
Е, ИМ.) = ed EIE S s s s .@% 


The variance within the pillar depends only on the residual, as is evident from the table, since 
the layer factor is zero in this context, i.e. 


E, M, re) = d ССБ 
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We now recall the statistic V „n defined by (xxv) of 11.05, viz. : 
Vin = Ё„.,— V(Ms. cs) — V(Me. rs) — M(Ve. ros). 
Whence from (iii)-(v) : 
ву) е=х= P= MED, a 


Accordingly, we may define the following statistics : 
ЕДӘ) = о} + no2 + nro? if s= ner. (М...) +(€—1); 
EJs) = о; + nog + noo if sẹ = пог. V(My. r) + (r — 1); 
E,(s2,) = o + noz. if g =ne. Va + (7 — ic- 1); 
Ej(s3) = o? if 52 = ner . M(V z. ers) + сп — 1). 
For purposes of computation, we may set out the foregoing results in accordance with the 
schema of (xxv)-(xxxi) in 11.05 : 


Mean Sums of Squares | Divisor | Estimate | Expected Value 
S-S | e— D o} + nof, + nro 
S,- 5 r—1 s | о} + поз + псо? 
S + Ser — Se — S, (r = 1c — 1) sh | of + поз 
Se — Sor re(n — 1) så | % 


Complete 3-factor Analysis without interaction: 
If we proceed in accordance with (ii) above, we have 
E,. V(M.. e) Em EV. B) = E.M(V z. cs) 


ner lace lat Int la 

nr—1 r—1 n—1 

ааа 
_. E,. ИМ ele Ce bn R 
Ue By. w. cs) = zi: de Стае А * 5 Я * ‚ (vii) 

In the same way we derive 
—1 —1 

Е,.У(М..„) = o0. 0. 0. Gull 


n—1 
n 


Е,.ИМ..)= ETT. 0. 0. 0.) 


Hitherto, we have based one item of our balance sheet on the difference between the total variance 
and the parameters used to evaluate all the remaining estimates. So we now define 


Vy = Va. — V(Mz. cs) — V(Mz. rs) — VM, s). 
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Whence from (vii)-(ix) : 
nr—1, c—1l r—1 n—1 


ЕУ % ог o; 


mimo n и оу АБЫ т 
ner 


For purposes of computation, we may set out the results implicit in (vii)-(x) as follows : 


Mean Sums of Squares Divisor Estimate | Expected Value 
Se= 8 c—1 E: o + nro 
S.—S r-1 E] of + псо? 
Sa- 5 n—1 a o + croi 

Se — Se — Sr — 5, + 28 mr—c—r—n42 33, oi | 


As a clue to what follows, note that in this table, as in its predecessors and as in 13.04, the 
total of the first column is S, — S, the sum of square deviations from the grand mean of the 
sample. 

pomo of Interaction, ‘The assumption of (i) is that we have 3 strictly additive factors 
of which the third is referable to circumstances inherent in replication. Exact replication is 
not always possible, never perhaps in sociological enquiry. It is presumptively realisable in 
laboratory practice with due precautions against introducing a new systematic source of error ; 
but the balance sheet given above is meaningful only on the assumption that an independent 
and strictly additive source of error peculiar to each n-fold set of cell-scores contributes to the 
score value. This assumption is highly arbitrary ; but our examination of its implications is 
not valueless on that account. ‘The interest of the procedure resides in what it can tell us about 
the relevance of the additive postulate. Any departure from additivity will appear.as a cell to 
cell variable within the layer, but constant within the pillar. Hence an estimate (52) of the residual 
based on the square deviations from the pillar-means will not be affected thereby. On the other 
hand the statistic (s3,) which involves deviations from row-, column- and pillar-means will take 
into account any cell-to-cell variation other than that due to the distribution of the residual 
score component. Hence estimates of the universe variance based on these two statistics will 
be consistent, only if the additive principle is valid and no systematic source of cell-to-cell varia- 
tion arises from faulty experimental design. 

If the result of a significance test to assess the consistency of the two estimates is to encourage 
the belief that there is in fact a source of variation peculiar to the n scores of the pillar within 
the sample stratum, we may interpret the result in one of two ways. If convinced that the 
replication introduces no source of systematic error, we conclude that there is interaction between 
row and column factors, i.e. that the additive principle does not hold good. To record the cell- 
to-cell component of variance in a balance sheet as interaction is then misleading, since zero 
interaction is inherent in the rationale of the balance sheet. Alternatively, the replication may 
involve an unrecognized specific source of systematic cell-to-cell variation. It is then possible 
that the balance sheet is valid, but the data of the experiment do not suffice to justify the assertion 
that it is. 

On the other hand, the data of an experiment amenable to 3-way classification do permit 
analysis with a view to deciding whether the 3 specific criteria refer to additive components, 
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For we can postulate 3 systematic cell effects in addition and test the hypothesis that each is 
negligible. For simplicity let us assume that we have other grounds for believing that there 
is no interaction between Fh, ns and either F;.,,or F;.,,. Our concern is then with the possi- 
bility of interaction between F;.,,and F;.,, Accordingly we postulate : 


Xy. a= быз. a + Fi с, Е. + Frnt Fuss 
By the foregoing procedure we should then derive 


ner — l c—1 r—1 2—1 g—1s. 


4+ 


Е,. И... = 


г 


Еа) Ле) ` 
ner ст 


We may define a statistic whose expected value involves o; alone by 
Vaer = M(Ve.ns) + M(V z. rs) — Vi. o 


ойыу eta. 
Our balance sheet then takes the form 
Mean Sums of Squares Divisor Expected Value 
5,— 8 c—1 a? + nog, + nro? 
S,—S ræ оў + nog, + ncog 
С ЖД of + cro? 
SENS 9,5. (r — 1c — 1) o? + nol, 
S + Sa — 5, — S, (cr — 1)(n — 1) а? 


As stated, we are entitled to regard this as a balance sheet only if all 4 systematic factors 
are additive. We have no means of knowing this from the data of the experiment; but our 
concern is not to assess the contribution of a so-called factor of interaction. We wish to know 
whether there is a cell-effect which may or may not be indicative of interaction ; and the fore- 
going schema shows us which statistics (viz. the last two) must be consistent if there is no source 
of variation from cell to cell within the layer other than the residual. 

Exhaustive 3-factor Analysis. The last analysis is artificial inasmuch as we assume the 
knowledge that interaction between the layer-factor and the row-factor or column-factor is 
negligible, and its use is merely to clarify an exhaustive 3-factor analysis the aim of which is 
both to assess and validify the balance sheet for 3 specific criteria. Validification signifies that 
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we must interpret the data of the experiment with a view to demonstrating zero interaction at 
every level, i.e. between row and layer factors, between column and layer factors and (as above) 
between row and column factors. Accordingly, we postulate two hypothetical cell factors in 
addition to F;;,,. The latter is constant within the pillar of n-cells but varies from cell to cell 
within the layer of cr cells and is indistinguishable from the effect of interaction between F;, es 
and F;.,,. Similarly, we postulate F,;., as constant within the column of r cells but variable 
within the row-slab of nc cells; and Faz., as constant within the row of c cells but variable 
within the column-slab of zr cells. We denote the true variance of the three cell factors as 
оў, referable to Fy. , as before, o2, referable to F,;., and ož, referable to Fas.. In conformity 
with the Model II postulates, relevant data for the construction of the balance sheet involving 
the 3 specific and 3 cell factors are then as in Table 5. 


TABLE 5 


Expected Values of Components of Variance 


nig n Fises EF. Ж. Ys. Hus Pass 
Yes Be а аач tO. o 
n аа 
Viv 0 а she EE к 
Vem + . Чад “Сл Dya o Я 
Wem + x D о Ua o 
mí . 1514 0 14 o к 
LAT . = 0 0 98. 


We may surmise from what has gone before that 


(a) expected values of V(M,..,), V(Mz. +s) and V(M,.,;) will each involve the residual, 
one specific factor and one or more cell factors ; 


(b) expected values of V,, and analogous statistics (V., and V,,) will involve only the 
residual and cell factors ; 


(c) a statistic whose expected value depends on the residual alone is obtainable by sub- 
tracting all the foregoing from the total sample variance (И...) 
Accordingly, we define by analogy 
V, = MV z.ns) + M(Vz. ra) — MV a. nrs) — Visi 
V, = MV a.n) + MV a. а) — MV a. nes) — Va. s 
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EXHAUSTIVE 3- FACTOR ANALYSIS 


Complete Grid (2x2x2) 
i1 i 


Cell Components 


Fic. 105. The 3-factor Pattern. 


Whence we derive from Table 5 the following : 


м1, c—l1,.,7—1,,"—1 
ЕДУ...) = mee et = See оп 
poe me—l, wei. 
eI owe WU po uw? 
e€—1,.c—1,.c—1 c—1 
Е,.Ү(М,.„) = = e, + E a, 679% aa Cal 
Plier tl ee 
E, VM. n) = of + — of + ot, + os 
—1,,5—1,,mn—1 п—1 
КЫЙМ ns) = = % + om + One cap omi 
ES [deca rae е. 
ncr cr 
EV. (r — 1) 2 a 4€ WII Da; 
ncr nr 


Ха 1) e, (6109—10) 2. 


1 
ncr nc 
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The expected value of the difference between the last six of the above and the first is 
Vaer = Vu. s — V(Me. cs) — VM, rs) — ViMz. ns) — Van — Vie — Ver. 


Whence we derive 
(a — 1c — 1r — 1) 2 
g^ 


Бы) = = 


e p ems си — 
s трг d mer MU e) = oe 
imi mem pv] ize mmi 

mx V Myre) = SaS же MV ae) = Sq~Sne 


Fic. 106. Computing Schema for the 3-factor Pattern. 


For computation we may reconstruct the grid of r rows, c columns and 7 cell entries : 
(а) with r rows, n columns and c cell entries with cell totals Ths; (b) with л rows c columns and 
r cell entries with cell totals ke We then define by analogy with S,, of (xxix) in 11.05 : 


p tar ize 


henj 
2 575718; з.=1 > > Th 
€ ит ja тита 
Our complete specification of the 3-factor set-up is then : 
TABLE 6 
Mean Sums of Squares Divisor Expected Value 
Se- 5 c—1 of + пто? + noi, + rohe 
INS rd of + neo? + то, + со, 
S,- 5 n—1 а? + сто? + rohe + соў, 
S+ Ser — Se — S, e E of + not, 
5 + Spe — Sn — S. (n — Ife — 1) 9 + rohe 
S + Sar — Sa — Sy (п — 1; — 1) of + cod, 
5, + SS St Sn — See — Sue — Sar (п —1(c— 1) — 1) с 
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The last 4 entries of the foregoing table disclose which statistics must be consistent if 
05, оё, and су, are negligible. If they are so, we are entitled to assume that the specific com- 
ponents are additive. If so, and if we have also good reason to believe that the particular 
Model II postulates hold good, we may construct a balance sheet for the 4 remaining sources 
of variation in accordance with the foregoing prescription for 3-factor analysis without interaction. 


13.07 ONE CRITERION OF CLASSIFICATION 


In Chapter 7 of Vol. I we have seen that the sample mean score from a normal universe is normally 
distributed, as is the difference between two sample mean scores, On that basis, we can 
approximately assess the significance of a group mean difference. We can however formulate the 
null hypothesis in a different way. Given c groups of r scores, we may ask whether the assemblage 
of samples is homogeneous w.r.t. the column criterion of classification, ie. that the column 
mean differences arise only from residual sources of variation common to all. The problem 
of assessing the significance of a group mean difference is the particular case, when c = 2. 

Tf we lay out in 5 columns the heights of 5r children of one sex in 5 equal age groups regard- 
less of any peculiarities of the r score values of an age-group inter se, our concern is with only one 
criterion (age) of classification. On the assumption that the universe is homogeneous w.r.t. 
the column criterion 


me: EMVe.u) = 19; 


E(V..,) = 


E,V(Mz. c) = ЕУ...) — E,. M(V a. cs) 


re 


We may define as before a statistic whose expected value is o* by the relations 
А Е : 
ЕД2) =o? and f= zl Me. e) 
ic rM, — My 


i=1 ее} © 
Likewise we may define a second statistic whose mean value is o? by the relations 
E(d)—5* and $= MUV.. e), 


ga gg eu My 
og ке —© 
Aj 4-1) 

When our concern is with only one criterion of classification, we can develop criteria of 
homogeneity without imposing the restriction that the groups are all of one size. If not, we must 
interpret the operation E, for extracting the mean score or mean square score derivation within 
the column and E, that of extracting a mean column parameter with due regard to the weight. 
Tf there are in all z scores in the c columns, and r, scores in the 7th column, we therefore write 


(ii) 


ize jan lize 


"ess REG. E NELJ Er. 


isi Ti j=1 i-i 


As before, for the whole sample 


ЕДТ...) = e*. 
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For the variance within the ith column, we have 


ij=c 
E, MU...) = Е.В...) 1 S (i o ac selon 
i=l 
= i=e 
Е ИМ) tot 15 от ee 
i=l 
In these expressions 
i=e 
2.(—1-2—e, 
i=l 
АЕ, Mare) m E айй E NM = NES 
Accordingly we define s? and sj by the relations 
E(g)=ot and $= ИМ.) . 0. . 00 
E= ad $= MV) . . . a i 


Evidently, the above are equivalent respectively to (i) and (ii) when the number of items is the 
same in all classes, so that n = re. We must of course interpret V(M,.,,) and M(V z. ss) as 
weighted mean values, i.e. 


= imc inn 
ИМ...) =} È т(М,— My and MV) => > S fay = ate 
i=l eT 
Thus we have 
А 1 e 5 : E 1 zs om 4 
i596 ;— My. and тето 0 has 


When c = 2, we can write the column means in the form M, and M, referable respectively to 
r, and r, items, so that л = (ra + r»). Ву definition therefore 


M=".M,+—M,, 
n n 


2 (My — му Su, — Му and (M, — My = "aM, — Му, 


«dm rM, — My + ry — му = Ey, y 
LA F 2 
раа. 
(M, — М)? 


(ix) 
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When c — 2, we may also write (ii) in the form 


2 1 izr TAS 1 ?z^ м 
== 52, (x, — My + Xeno 2, (x; — MY : E Sox 
We may abbreviate (x) by the substitutions 
5 i А 1 =» К 
$= 2,2, (5 — М.) and $=- P3 (5 —My . . (xi) 


dod. 
We shall later see (16.06) that tests of significance w.r.t. homogeneity rely on the ratios of 
consistent and independent estimates of the true variance (o?) of the putative common universe. 
If, as we shall then see, 52 and sj are indeed independent, a ratio appropriate to the test of signifi- 
cant departure from homogeneity with respect to one criterion of classification is 52 + 55. When 
there are only two classes 
s (M, — My* 


ear a еа 


(С++ 


Ta 


The relation of (xii) to the square standard score of the approximate c-test of the significance 
of a group mean difference (Vol. I, Chapter 7) will suggest itself at once. Our unbiased esti- 
mate of the unit sample variance based on the pooled data is 


1 der 
m -——— > (x; — Mas)’. 
"— 


Whence we have for the group means 


For the variance of the mean difference we have therefore 


1 1 
(2+5) 


Whence the square of the appropriate c-ratio is given by 
(M, — M,)* 


2 = ‚ (xiii) 


n. 

When we have before us more than 2 groups distinguished in virtue of one criterion of 
classification (e.g. breed), our concern will commonly be to ascertain which mean values signifi- 
cantly differ. We must then base our estimate of the sampling error of M, on our estimate 


(52) of the residual variance оў. The true variance of M, in the absence of systematic sources 
of variation will be (oz ~ r;) and our estimate of it will be 


‚ (xiv) 


We may regard our sample score values as divisible into two independent components, an error 
component and a column factor in accordance with the equation 


Xij. s = Ciga + Fy. cw 
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By hypothesis, the systematic component is constant within the column, and we may therefore 
write 
7,—1 
ЕДУ...) = ———0 


› 
f 


eB, Mua) = Be. EAV s.e) = E [G2]. 
When the number of items in the columns is variable, we have seen above that 


ise 


E( Ves E79 


TA 


d-c -a 
у. E,. MV a.e) => бал) 168 


[E n 


We thus define our estimete of c; by the relations 


2- e 
Ei) =o} ad $= MV ae), 


5 4 5 . (ху) 


For purposes of computation it is convenient to express this in terms of sums of squares in accord- 
ance with the notation of (xii) and (xiii) in 11.05, viz. : 


M = Y ИМ) = 5, — 53 


Whence in (xiv) 


13.08 DEGREES OF FREEDOM 


It often happens that mathematical techniques with application in one domain of practice later 
become useful in a different setting. It may then be that verbal descriptions appropriate to an 
earlier usage invade a field in which their meaning has metaphorical significance for the mathe- 
matician only. We have already seen how the word moment has come to describe statistical 
operations whose connexion with statical mechanics is purely formal. "The current expression 
degrees of freedom is another example of such transference of associations. To the mathema- 
tician who is au fait with the dynamical theory of the gyrostat or spinning top it is rich with 
suggestive meaning; but it cannot be equally evocative to others; and one may well doubt 
the usefulness of verbal formulations for the student of statistics not already familiar with its 
use in other branches of applied mathematics. Accordingly, we shall first define its meaning 
as a numerical concept appropriate to the specification of an unbiased estimate. 
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In preceding sections of this chapter we have repeatedly met expressions exhibiting a para- 
meter (5,) of a universe as the expected value of an n-fold sample parameter (p,) in a form which 
involves an integer f less than 7 itself, i.e. 


E(p,) = i ЕД 


We then say that the sample statistic (p,) which is an unbiased estimate of р, itself is 
n 


= у?" 


For the number f in such expressions, it is customary to apply the term degrees of freedom 
(d.f.). This definition does not cover all uses ; and it does not obviously tie up with the literal 
meaning of the expression. It is therefore necessary to explain that statisticians speak of degrees 
of freedom to convey a seemingly quite different intention in the taxonomic domain. 

"The alternative usage arises from the need to distinguish between the number (f) of score 
classes sufficient to define a sample and the total recorded number (л) of such classes in con- 
tradistinction to items. In a classification involving one criterion (e.g. suit of cards) the rule is 
that f = (n — 1). For example, it suffices to specify the number of black cards alone in a sample, 
if our record refers only to the binary (black-red) system ; and we then say that the system itself 
has 1 d.f. If we classify our sample by suit, it is unnecessary to specify the heart score, if we 
have also specified the number of spades, clubs and diamonds it contains. In such a set-up 
n=4andf=3. 

The student need have no misgiving if the connexion between the two uses of the ex- 
pression is at this stage obscure, because each usage has a clear-cut domain. The one last 
mentioned may seem to be trivial at first sight. It calls for special comment only when the sample 
record invokes more than one criterion of classification. As a first example, we shall consider 
the construction of a 2 x 2 table which separately assigns the numbers of red and the numbers 
of black cards distinguishable as picture and other. If the sample consists of s cards taken from 
a full pack, it suffices to know the numbers in any 3 cells of the table, since the number in the 
fourth cell is obtainable by subtracting the 3-cell total from s. Hence f= 3. If the sample 
consists of s, cards taken from a half-pack of red only and s, from a half-pack of black only, it 
suffices to know how many picture cards each contains, and f — 2. 

An interesting situation arises when we classify w.r.t. one criterion of classification a sample 
of known size (s) and the residual pack of (52 — s) cards, as in the schema below. If we are 
entitled to assume that there are 12 picture cards in the 52-card pack, our knowledge that the 
s-fold sample contains x, picture cards suffices to define how many cards each cell contains and 


f-1 


Sample Residual pack Total 
Picture РА x, = (12 — x) | 12 | 
Other | s— x, 40—5s-cx, 40 I 
"Total s 52 -s | 


- 


On the other hand, the mere fact that the pack contains 52 cards does not necessarily mean that 
itis a full pack in the ordinary sense. If we cannot assume that it does contain 12 picture cards, 
we cannot derive the value of x, from tbat of x,, and we must assign 2 d.f. to the system. 
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Let us now suppose that we take two samples of known size s, and s; from a full pack and 
classify the results as in the 3 х 3 table below. 


First sample Second sample Residue Total known 
Aces a | A = 4 
Picture b, | b, tee 12 
| 36—5—5- 
Other а-а-һ | ab m ce EUM E 
"Total 5 | s ee 52 


In this set-up we can fill 9 cells, if we have the information to fill any 4 of them. In each 
of 2 = (3 — 1) rows, we have to fill 2 = (3 — 1) cells or (3 — 1)(3 — 1) inall. More generally, 
it suffices to fill (r — 1)(с — 1) cells of a grid of r rows and c columns, if we know all the marginal 
totals, but if we merely know the grand total we then need to fill (rc — 1) cells. If we do know 
all the marginal totals, we therefore assign (r — 1)(с — 1) d.f. to the system. If we only know 
the grand total f = (rc — 1). The expression degrees of freedom is meaningful in this context 
in as far as it specifies how many cells of a grid we are free to fill in any way consistent with the 
prescribed conditions without forfeiting the power to fill the remaining ones. 

We have now a clue to what lies behind the use of the term d.f. for the denominator in our 
unbiased sample statistics for foregoing sections of this chapter. In the two-way set-up, the total 
sample variance makes use of only one item of information about the rc cells in the grid, viz. 
the grand mean (M). If this is the only fixed parameter of the grid, we are free to assign scores 
of any value not exceeding an aggregate of rcM to (rc — 1) cells. On the other hand, our ex- 
pression for s? involves also the mean value of each row and each column. In the same sense, 
therefore, we are free to fill only (c — 1) cells in each of (r — 1) rows. The total then is the 
product (c — 1)(r — 1) which replaces rc in the denominator of V,. „апа is what we have other- 
wise defined as the d.f. of the statistic 52. 

The foregoing remarks throw no light on the use of the term, when we later speak of a Chi- 
Square variate for f degrees of freedom for reasons explained in 16.04. There we shall also see 
why degrees of freedom are additive in the sense that the total of the divisors of a complete balance 
sheet is the divisor (rc — 1) or (ncr — 1), etc. of the unbiased sample statistic of which the 
numerator is rc. V., or ner. Vz. ,, etc. 


AN ARITHMETICAL EXAMPLE 


The following illustrates the procedure for estimating residual variance of data involving : 
(a) one criterion alone ; (5) two criteria of classification, The figures are from a paper by Rogers 
and Johnstone* who used aerial slit sampling to compare the effect on the number of bacterial 
colonies obtained from air of a hospital ward after sweeping an oiled floor with a broom and after 
use of a vacuum cleaner. The same ward of a premature baby unit was swept by a broom on three 
successive days following the day the floor was oiled, and by a Hoover on the same three days 
of the next week. Counts were made on culture media exposed at intervals of one minute during 
the three minutes before sweeping began, at one minute intervals for four minutes while sweeping 


* Rogers and Johnstone, 1951. ў. Hyg. 49, 497. 


ASSUMPTIONS UNDERLYING ANALYSIS AND SYNTHESIS OF VARIANCE 575 


went on and at one minute intervals for three minutes after it ended. Counts made on the days 
when the ward was swept by a broom were as follows : 


Successive Observations Wednesday Thursday Friday 


Before sweeping 1 59 40 40 
2 50 37 35 

3 61 + 32 

During sweeping 4 56 22 40 
5 50 21 20 

6 30 30 24 

7 62 66 23 

After sweeping 8 63 40 22 
38 30 23 

10 32 30 23 


If we first assume that the only systematic source of variation is referable to the effect of 
sweeping, we set out our data as below. We have then 3 columns and 30 observations in all, 
so that (n — c) — (30 — 3) — 27. 


Before During After 
Day and Minute Sweeping Sweeping Sweeping 
(хә) (хь) (х) 
Wednesday 1 59 56 63 
2 50 50 38 
3 61 30 32 
4 62 
‘Thursday 1 40 22 40 
2 37 21 30 
3 44 30 30 
4 os 66 F 
Friday 1 40 40 22 
2 35 20 23 
3 32 24 23 
4 23 
No. of observations 9 12 9 
> х, = 398; Dx = 444; Dx. = 301; 
M, = 4422; М, = 37:0; М, = 3344; 


У (х. — М„)* = 85556; У (х — М): = 32380; У (x, — M, = 131222; 
f= {ми — M+ Ee- му} 


= g; (85556 + 3238-0 + 1312-22) = 200-21. 


Thus our residual variation (s,) is +/200-21 = 14-15 and the standard errors of the means are 


M, M, М, 
m 2472 Jma 109 mea LE 
9 12 9 
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'Thus we have for the standard errors of the differences between the means 
(M, — М,) and (M, — М.) M, — M, 
VERE + (409) = +624 VET = +667. 
We may thus summarise the outcome of our calculations as 
(M, — My) = 722 +624; 
(M, — M.) = 1078 + 6:67 ; 
(M, — M.) = 3:56 + 6-24. 
None of these differences is significant at the 20 level ; but we may be misled by the circum- 
stance that our estimate of residual variance is excessive because of failure to eliminate a second 


source of systematic variation, viz. the number of days which have elapsed since oiling the floors. 
Accordingly, we set out our data thus for two criteria of classification : 


10 10 2 
Before Sweepit ing Sweepi Aiter Sweepit 
ping During Sweeping ping Si EM [z-] M, 
Minute : 1 2 3 4 5 6 7 8 9 10 i=1 i=l 
Wednesday 59 50 eaj s s æ% e| e зв 32] so 25100 | 50-1 
Thursday 40 37 4| ж 21 30 66] 40 30 30| 360 120600 | 360 
Friday 40 35 s2| 40 о ж zaj 2 2з 23| 282 7054 | 282 
3 
2 Р 189 122 137) ив 91 s 181 | 125 91 85 
j=l 
3 


z 
[>] 19321 14884 18769 | 13924 8281 7058 22801 | 15625 8281 — 7225 
jet 


M, 4633 4065 45:67 | 3933 3033 2800 50-33 | 41-67 3033 2833 


У а 6681 5094 6681 | 5220 3341 2376 8729 | 6053 2873 2453 


We now calculate the residual variance by the formula 
an Stu- 5—5, 
E 


In this expression 


j=1 i=1 
e r 2 
g= rl = 45389-0; 
T i21 үү 
1/5. B 2 
s,=1 5/5 Я = 46012:5 ; 
єў 
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In every column of the last table the number of observations is 3. Whence the variance of each 
column mean is the same, viz. 91-54 + 3 = 30-51. The variance of the difference between each 
pair of column means is also the same, viz. : 30-51 + 30-51 = 61-02 and its s.e. is V/61-02 = 7:81 
The column means are as follows : 


Before Sweeping During Sweeping After Sweeping 


46:33, 40:67, 45:67 39°33, 30°33, 28'0, 50°33 41°67, 30°33, 28-33 


Thus the greatest and least difference between the before and after column means are now 
(46-33 — 28:33) = 18 and — 1 each with a standard error of 7-81; and this method of analysis 
discloses nothing to discredit the conclusion suggested by the foregoing treatment. 

We may now look at the same data set out in each way from a different viewpoint. If we 
adopt the one-way classification we may ask whether the grid is homogeneous w.r.t. the column 
criterion. If we adopt the 2-way procedure, we may ask whether our data justify the assumption 
that there is a second source of systematic variation implicit in the row criterion. То test homo- 
geneity w.r.t. the column criterion in the one-way grid, we require the statistic of (viii) in 13-07, 


vis. 
1 ix 


>м ему s o9 o oo d) 


2 
ga 
Ses) 


To test homogeneity of the row criterion in the second lay-out, we require the statistic s? defined 
by (v) of 13.03, viz. : 

S,— 8 
fus r—1 


(i) 
In the first lay-out, (c — 1) = 2 and 
М = (398 + 444 + 301) = 38-1. 
Whence we have 
sg = $(4422 — 38-1)? + 42(37-00 — 38-1)? + $(33-44 — 38-1)? = 273-525. 


Thus the variance ratio for the test of homogeneity w.r.t. the column criterion in the one-way 
lay-out is 


mA o. ow cen os 8 di) 


In (ii) since (r — 1) — 2, 


$= 5 = 920-35. 
Thus the required variance ratio is 
s$ 920-35 Я 
Ее . ` 5 . . . (iv) 


At this stage, we have not established the appropriate test of significance (Chapter 16) for 
(iii) and (iv); but here note that (iii) is a ratio of variances with divisors (c — 1) — 2 and 
(n — c) = 27, while (iv) is a ratio of variances with divisors (r — 1) = 2and (r — 1)(с — 1) = 18. 
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As we shall later see, the expected values of (iii) and (iv) are respectively 27 + 25 — 1-08 
and 18 + 16 = 1-125. At the 5 per cent. significance level F for the divisofs (so-called degrees 
of freedom) is about 4-2 and about 4-4 for 2 and 18. At the 1 per cent. level F for 2 and 18 d.f. 
is about 8:3. "Thus there are high odds for a systematic source of variation associated with how 
recently the floors were oiled, and our use of the lower estimate for the residual variance is ac- 
cordingly justifiable. We may accordingly recalculate the standard error of the mean for our 
initial lay-out of 3 columns as below : 


M, or M, M, 
91-54 91-54 
К, Tg = 32 r~“ 27. 


Whence our corrected differences are 
M, — M, = 722 +42; 
M, — M, = 1079 + 45; 
M,—M,= 356 +42. 


Addendum. This chapter embodies the writer’s method of presenting to students of biology 
assumptions which underlie the Analysis of Variance at a time when the concept of significance 
had not yet become the target of a formidable body of criticism, as explained in a final 
chapter written after the rest of the book had gone to press. It may be too early to surmise 
how far the technique of estimation embodied in Churchill Eisenhart’s exposition of his Model I 
situation will stand the test of time ; but we may be confident that the battery of test procedures 
based on the F-ratio, as expounded in Chapter 16 below and illustrated by the foregoing numerical 
example, will retain no place in a future curriculum of statistics, if the views of Wald and Neyman 
gain ascendancy. Meanwhile, some of the foregoing exposition may not be valueless, if it 
focuses attention on neglected factual assumptions implicitly invoked by those who continue 
to use the method. 


а 


CHAPTER 14 


MORE ABOUT MOMENTS 


14.01 REALITY AND RIGOUR 


Statistics is a branch of applied mathematics. As such it involves issues of two kinds, correct 
mathematics and correct application. The theme of our last two chapters has been the latter, 
in so far as our concern has been to explore in what circumstances assumptions implicit in the 
statistical techniques known as correlation and analysis of variance are more or less relevant to 
the real world. Having decided, with appropriate reservations, to adopt a procedure of one or 
other sort, we come face to face with the problem of significance. "This is partly a mathematical 
issue and partly a matter of common sense, i.e. awareness of reality. In Chapter 16 we shall 
deal with significance tests appropriate to the issues raised in Chapters 12-13. In this Chapter 
and the one which follows our aim will be to lay the foundations. First, we may pause with 
profit to get clear about what we are discussing when we invoke a significance test. 

A significance test assigns the odds for or against an occurrence prescribed by a particular 
hypothesis. As such it tells us the ratio of all frequencies of a class of events which exclude its 
specification to all frequencies of a class of events which include it. From a mathematical 
viewpoint this is an exercise involving the summation of two sets of frequencies. From a 
practical viewpoint, the outcome is not unique unless we have some additional information to 
guide us in assessing what odds justify the rejection of the null hypothesis. Thomas Bayes 
pointed this out two hundred years ago, though it is still a common delusion that odds of 20: 1 
(or 370 : 1, according to taste) against the occurrence on the assumption that the null hypothesis 
is correct suffice to justify us in rejecting the latter. 

In this context, there is no need to elaborate previous remarks (Chapter 5, Vol. I) on so 
prevalent a misconception. Our task is here to clarify what we do when we assess the odds ; 
and this involves prior knowledge of the parent universe. When we can exactly specify the 
universe (e.g. cubical die or card pack) from which we sample the procedure is easy to formulate 
and to visualise in terms of the areas of columns (Chapter 3, Vol. I) of a histogram of unit area. 
The nature of the sampling process and the distribution of corresponding unit scores in the 
parent universe supply all the information relevant to the specification of the r-fold sample by 
methods now familiar to the reader; but the exact distribution of unit scores in the universe 
of scientific enquiry is something we rarely know. Indeed, a 2-class universe (e.g. hearts and 
other cards) is the only one of which it is true to say that the algebraic form, i.e. (9 + Р) of 
the unit sample distribution (u.s.d.) is implicit zm the definition of it. In the domain of 
representative scoring, we can so specify the algebraic form of the u.s.d. if we score by rank 
but then only if there are no ties. If so, of course, the distribution is rectangular. Otherwise, 
experience alone can justify whether a particular mathematical expression is or is not a reliable 
description of the universe of which our observations constitute a sample. In seeking such a 
description as a basis for a prescription of the consequences of sampling, we are not entitled to 
expect that we shall be able to find an exact one; and if we have to choose between several 
seemingly good enough expressions, mathematical convenience will necessarily influence our 
choice. That is to say, we shall prefer an expression which is most amenable to the algebraic 
manipulations invoked by sampling theory. 

One relevant consideration in this connexion is that mathematicians are much more skilful 
in assessing the area of segments of a continuous curve (e.g. the normal) than in summing exactly 

6 
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a series of terms increasing by finite steps. We can, however, accomplish the latter approxi- 
mately by visualising the contour of a histogram as the jagged outline of a continuous curve ; 
and the outcome is often as precise as need be. Curves which are monotonic (p. 328, Vol. I) 
or unimodal have special descriptive advantages, because we can specify the properties of a wide 
range of types by the method of moments (Chapter 6, Vol. 1). From a mathematical viewpoint, this 
is a great convenience ; but it is important to remember that we rarely, if ever, meet a statistical 
universe to which we can be confident in assigning a continuous unimodal curve (e.g. the normal) 
as an exact description of the score distribution. It is conceivably true that such a curve 
would truly describe the distribution of the weights of beans in a pure line: but it is an act of 
faith to assert that in fact it does so. What we may know is that our observations exhibit no 
discontinuities if we plot them appropriately ; but an inescapable limitation to any legitimate 
inference from this procedure is that our measuring instruments involve a scale of finite 
increments. 

Advances in the theory of statistics leading to the distributions of Chapter 16 have gone hand 
in hand with greater concern for rigour, i.e. exacting criteria of what we can rightly infer from 
our initial assumptions ; but how far this will eventually prove to be a sign of healthy growth 
must depend on how far we fully realise the adequacy of the initial assumptions as a description 
of the real world. It is especially needful to be on our guard against the plausibility of the follow- 
ing syllogism : (a) such and such a distribution closely describes the universe of our observations ; 
(b) sampling from a universe with such a distribution leads to certain consequences ; (c) sampling 
from the universe of our observations has the same consequences. This is a mom sequitur. 
The first premise is purely empirical, the second purely formal and (с) is valid only if the 
procedure involved in (5) does not unduly magnify any of the errors implicit in the qualification 
closely. 

In conformity with these considerations, we are committed to scrutinise any argument which 
starts with the assumption that a universe is normal or that of an r-fold sample therefrom 
is normal. We shall be in a better position to appreciate how often such an assumption is 
legitimate for practical purposes, if we examine the characteristics of discrete distributions with 
a view to formulating criteria of the adequacy of substituting a normal (or other continuous) 
curve as a descriptive device. In this, and in the next two chapters, we shall assume two pro- 
positions to be acceptable without elaborating earlier remarks (Chapter 6, Vol. I) on the meaning 
of moments as descriptive parameters of a distribution : 


(a) if all the moments of two distributions are identical, we are entitled to regard the dis- 
tributions as identical ; 


(b) if all the moments of one distribution (B) lie between those of two others (A and C) 
which tally sufficiently for practical purposes, we may use A or C (as most convenient) 
to describe B. 


"These assumptions sufficiently explain the need for a closer study of procedures for evaluating 
moments (14.02 and 14.03) and for examining (as in other sections of this chapter) the circum- 
stances in which the moments of a prescribed sampling distribution approach those of the normal 
or other continuous function which is easy to tabulate for reference. Not all the material in 
what follows is essential to an understanding of the rest of the book ; and the reader may well 
prefer to scan this chapter quickly, returning to it at a later stage if necessary. 

When we say that a continuous variate (y) is satisfactory as a function descriptive of a dis- 
crete sampling distribution, we may adopt either or both of two criteria, having in mind the 
relation of the approximate fitting curve y = f(x) to the contour of the exact histogram. We 
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construct the latter * on the assumption that the area of each column of height y, on a base 
extending from (x — }Ax) to (x + 3Ax) is numerically equivalent to the frequency (fz) of the 
score x. Since the sum of all frequencies is unity by definition, for a score witb positive values 
only 


ot ee s, hs eR ORT 
z-0 z-0 


The reader will note that the exact limits are irrelevant, since f, = 0 if x lies outside the range 
of permissible score values. If x may be negative or positive, we must write the above as 


z-0 © 


> fe=1= È ye Aw = : 5 s . (ii) 


z-—0 


'The sum of the frequencies in the range x — a to x — b is 


$5-s-X*»s. MOS MET 


The actual boundaries of the corresponding columns of the histogram of unit area are not the 
mid-points a and b but (a — 3Ax) and (b + 3Ax). 
With due regard to these considerations, we may ask for a fitting curve such that 
(a) if the ordinate y at x goes nearly through the mid-point of the upper extremity of the 
corresponding column of the histogram, we can approximately specify the frequency 
of the score x if we know the scale Ax, i.e. 


у= у„ and yi Aref, - . . . . (iv) 

(b) if the area bounded by the ordinates of the curve at x = a and x = b corresponds closely 

with that of the segment of the histogram with the corresponding boundaries at 

(a — 3Ax) and (b + 44x), we can approximately specify the net frequencies of score 
values within the range, i.e. 


Z A= breit dms бый an.) 


2а 

In accordance with our definition of frequency, any such fitting curve must also fulfil the 
criterion of unit area over the whole range of permissible values of x itself: (i) positive only, 
(ii) negative and positive : 


z-b 7 


a—the 


O |" y-de—1 i) P vani. EEN 


'To make the foregoing criteria explicit we have to define a criterion of error, as follows : 


(a) if e, is the error consistent with a satisfactory ordinate fit in a specified range, we may 
express (iv) more explicitly as 


(у. — y)- Ax < lel QN ed eG УН) 
(b) if eas is the error consistent with a satisfactory expectation fit 
Soo — las < leal - З . s 7 . (viii) 


* The reader may find it useful in this context to read more detailed remarks on the build-up of the frequency histo- 
gram in 15.01 below. 
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In discussions on curve fitting, there is not always an explicit recognition that the two criteria 
defined by (vii) and (viii) have different domains of relevance. If we are seeking a criterion of 
goodness of fit for an empirical distribution (vii) may have more to commend it, inasmuch as our 
main object in so graduating our data may be to assign a numerical value to the frequency of the 
occurrence of a particular score. This is not the end in view when we perform a significance 
test. Our concern is then to sum frequencies of all score values which do not exceed a specified 
limit or limits; and (viii) is the appropriate criterion. The distinction is important in so far 
as no unimodal descriptive function could be satisfactory in the sense defined by (vii), if the 
exact distribution has gaps such as we have seen (Chapter 4, Vol. I) to be characteristic of the 
distribution of the proportionate score difference distribution of co-prime samples from an 
infinite 2-class universe. On the other hand, the fact that we can eliminate such gaps by group- 
ing disposes of any objection against seeking a satisfactory fit in accordance with (viii). 


1402 Moment GENERATING FUNCTION 


The type of generating function dealt with in 11.08 is one of many ways of summarising 
the operations of the independence grid with a view to specification of a sum or difference dis- 
tribution. The essential desideratum of such a g.f. is that the dummy factor which identifies 
the score value associated with a particular frequency as a co-factor obeys the product rule for 
indices, viz. 1* . = 19 and t. t^^ = 1°-®. This, of course, is equally true if we express £ 
in exponential form аз t = e", so that e°". ^ — 910%, If u, is the frequency of the score 
x we may therefore label our dummy co-factor as е^ defining a new class of generating functions, 
exactly as before with the substitution ¢ = e", so that 


Gu = ty + ще + ue? + use™ . . . uu д : о ve) 
G., = ty + uk Hun un . . и" Я s . (ii 


If we label the cell frequencies of the grid for 2 independent variates u, and v, as y; = що; 
in accordance with the schemata exhibited in 11.08, the rules for the summation of frequencies 
of the sum (s) and difference (d) are as there given, viz. : 


z-s z=d 
Y,= = Yu-ne and Y= = Warnz- 


If G, and G_, are each referable to score frequencies of the unit sample distribution, x, and 
хь are respectively score-sums of independent a-fold and b-fold samples from the same universe, 


С(х„ + хь) = Gat and G(x, — x) = G2. G^, а : . (üi) 


For the proportionate (or mean) score difference distribution : 


2h Bh 


Pe à n а а d ж 
G! m = (и + ше + use? + use . . ) huo + me 5 + ие » + use © MS e 
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TABLE 1 
‘Tue M.G.F. as a Grip OPERATION 
Second Zero Moment of Heart-Score sums w.x.t. 3-fold and 2-fold samples taken with replacement from 


two full packs 
3-fold Sample 
Raw-Score 0 1 2 3 
Exponential Score e e e e 
z z $ i 
реку a a и a 
2-fold Sample 
s=0;#=0 s=1;s=1 s=2;s=4 s=3;s1=9 
А = её ome as em e 
oe 16 
243 
Y» = nmn 31 = 305 Ую = i 
s=1;8%=1 s=3;8=9 s=4;s'=16 
n = =e “= 
1 eè i 
162 54 
You = jog Yn = 104 
гаа Ц з= 4; 02 = 16 
1 е e е = oth 
2 г 
27 9 
yo = d Ун = 194 m= 
Diagonal Frequencies (x 1024) 
Y, Y, Y, Y, Y, Y, 
243 405 270 90 15 1 


E(e™) = 2-1(243 ++ 4056 + 270^ + 90e? + 1560 -+ e); 
Dj. E(e^) = 2-%%(405е^ + 10806% + 8108 + 240et + 25e?) ; 
Dj-,E(e^) = 271*(405 + 1080 + 810 + 240 + 25) = $; 

E(s) = кз) = $ = Spq + 5*p*. 


In doing this we have done nothing new, since t = e is merely a dummy for purposes of identifica- 
tion; but the substitution has the merit that the generating function so expressed has a dual 
purpose. We can use it as before to write down the terms of a sampling distribution; but we 
can also use it to evaluate its moments in a new way by taking advantage of the differential pro- 
perty of е, viz. : 

ot x MA 2, tht 


Еа реце: 
D,(@") = 0 + x + xth 4 i } = = | = etc. ; 
Ре) — 0 4- 0 4- a? + хәл 4 = : = - = etc. ; 
Ое) OHOH OH a 0 +” чю. 
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TABLE 2 


‘Tue M.G.F. as a Grip OPERATION 


Second Zero Moment of Heart-Score difference (d) w.r.t. 3-fold and 2-fold samples taken with replacement 


from two full packs 
3-fold Sample 
Raw-Score 0 1 2 3 
Exponential Score e e as е^ 
Р 2 9 1 
‘Frequency а a a a 
2-fold Sample ( — 
d=0;d'=0 d—1;di-1 d=2;d=4 4=3; Ф = 9 
х e-e mae en Lg е gh 
о e 16 
9 
Ую = 1094 Узо = Toad 
d=1;dt=l d=2;d=4 
A е = ә aa 
1 e i 
You = m DESC э = n= н 
d-2—-2;dà-4|d-—1;dà-1| 4=0;@=0 d=1;d=1 
1 et = en e = еа = е Mae 
L qoas 
9 
| Ja = 2 Ju =й Уз 95 Уз = Ti 
Diagonal Frequencies (X 1024) 
Ya Ya Y, Y: Y, Y, 
27 189 414 298 87 9 
E(e4) = 2-10(27e-* + 189e-* + 414 + 298e + 878^ + 989); 


Dj. E(efh) = 2-19(108e-* 4 189e-* + 2988 + 348e% + 81e) ; 
Dj-,E(et?) = 2-1*(108 + 189 + 298 + 348 + 81) = 1 = p,(d); 
E(d*) = 20 ‚ 414 + 1.189 + 298 + 4,27 +87 4- 9.9) = 


(4). 
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In general therefore 
Ud kè 
Die) = x* + Ah caller + alle etc. 


When Л = 0, this reduces to x*. Hence we may write 


Diu, eo = Ue 5 


DN GOL 5. fig x^. 


° 


We make the upper limit of summation infinite in the above, since y, vanishes for all values of x 
greater than its highest value. We now recall the definition of the kth zero moment of the 
u.s.d. :* 


=o 


њ= X uc 


DU I ean Osa md е nu Ve 3с) 


"The operation holds good, of course, for generating functions of the a-fold distribution, the score ` 
difference distribution, etc. 


Example 1.—Find the moments of the distribution of the mean score for the 3-fold toss of a 
tetrahedral die with face scores 1, 3, 5,7. The g.f. of the u.s.d. is 
Моеъ oom = S + ehe og ay, 


That of the 3-fold sample score-sum is 
Ly 
at + eth + eth + eft) — <a - ef^ 4 Geth p 102% 4 12295 4- 1210h + 109128 4 Gel Zel6h+ gl8h), 


For the mean score we may write this as 
a a 9 n m 

dale + Зе ® + 6e? + 10e? +12? ...е3) = С. 
We now apply the rule : 

(Dj. е^) = х^, 

^ pe = Gall + (D + 609) + 10(8)*. . . .] 

By recourse to the chessboard procedure, the reader will easily see that this is the weighted mean value 
of the kth power of the 3-fold sample score mean. 


* * * * * * * 


The foregoing example merely illustrates how the operation of extracting the moments 
works in so far as it dispenses with the need to visualise each step by recourse to a grid lay-out. 


* We here assume that the range of scores is positive only. More generally, pẹ = E(x*) for a score x with weighted 
summation over the whole range from — co to + co as for the burette universe of 14.05 and exercise below. If 
М, = 0 we then have py = m. 
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What is more important is that we can use it to derive results of general interest. In this con- 
пехіоп we may note that the operation of determining the Ath mean moment (л) is precisely 
analogous to the foregoing procedure. If yy is the frequency of the score deviation X our 
m.g.f. is 


E] 
G(X) = > Ir 
2 
The kth differential w.r.t. h is 


S XP 4 XE #8 aro yas " 
20x RO toy S EI 


When h = 0 this reduces to 
E] 
x Jr = E(X*) = т,. 


E- 


Expressions of this type simplify in virtue of the identity m, = 0 = E(X). En passant we may 
also note that ро = E(a?) = 1 = E(X’) = то, i.e. G(x) = 1 = G(X) when h = 0. An alterna- 
tive way of labelling our frequencies leads to a familiar series of formulae. If we write ш = М, 
so that X = x — M: 


© © © 
2-9 = Ja s 87 M = (Ив 2 ys. Os 


= GAX) = MG s). 

If we write for brevity w = G,(X) and ж = G,(x), 

Dyw = e^ , рух — Ме; 

Dij = e^, Diz — Ме МА, руз + Ме М — Мем. Dz; 

Diw = e^». Diz — ЗМе МА, Diz + 3M*e0^ ‚руз — Me Mhz, 
When Л = 0 so that z = 1 = e™* and [Же = ць, we have 

m, —0; m, = p — M?; тз = из — 3My, + 2M*. 

Similarly, we may obtain higher mean moments in terms of zero moments. Likewise, we obtain 
the familiar expressions for zero moments in terms of mean moments, if we write 


G,(x) = e'"^G,(X). 


In what follows we assume that our scores increase by unit steps (Ax = 1), since the 
appropriate scalar transformation is straightforward if this is not so. If z = ax, so that Az = а 
we may write 

E(z*) = E(xAz}* ; 
vs pala) = (Аз). pafa). 


In particular, if x, is the score-sum of the p-fold sample, that of the mean score is (х, + p) = x, 
and x, = P . Xm, whence у(х) = p* . р(х) and 


Bag.) = Pp 
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By recourse to the properties of the m.g.f., we can establish general rules for the derivation 
of the moments of the 7-fold sample score-sum and mean score in terms of the moments of the 
usd. Later we shall see that the same rules are deducible by iteration (14.04 below) and by 
recourse to the multinomial theorem (17.03). For brevity, we shall write z as the m.g.f. of the 
u.s.d. of scores which increase by unit steps, so that 2” is the m.g.f. of the r-fold score-sum 
distribution, and we may therefore write 


2" = (up + ше + use + use...) 
We now recall Leibnitz’ rule for deriving D}(2") when ж = f(h), so that 
Р(х)? —2D,z.Djz and Р(х) = 3(Dy2)? . Dis. 

We may then write 
Р = r2f1 Das ; 
Djs! = r9 2°-2(Dyz)* + r2'7* Djs ; 
Dis! =: rs! (Ds) + 3r/9277*D,z . Dx + r2 3 Djs ; 
Dis! = 92-х) + 679 2-9(D,2)*Dzz + 37927-3(Dj2)* + Ar 23 Dys . Djs + та" 10. 


If we set л = 0 in these expressions, denoting by jj and p(7) the Ath zero moments of the 
u.s.d. and r-fold score-sum distribution respectively, we then have 


par) = тщ © . : & . 2 > : б =. у) 
рабт) = 204 ru. . SNP E Ө d : : . Wi 
par) = 1 uh + Зл), . ра + и Tae (vii) 
par) = rui + 6r uius + Bry + Arpa a pa + Ty + (vii) 


Mean moments can be derived from the above in the usual way ; but we can do so directly 
by the preceding method. If we define 2 appropriately as the g.f. of the mean moments of the 
u.s.d., the result is formally identical, but the expressions simplify in virtue of the identity 
m, = 0, so that 


m(r) =0 =m, 5 : 3 E : . (ix) 
mé(r-rm, . Я E à А : tx) 
т) = тту . S 5 : 5 Е IT) 
m,(r) = 3r?m$ + rm, Я : 2 . . (xii) 


One use we can make of the above is the definition of the moments of the r-fold sample 
score distribution defined by successive terms of (4 + p). The u.s.d. is q; p for scores 0, 1 
or score deviations — p and q, whence 


py =p; m = q(— p} + pg". 
We therefore obtain 
nr) = т; 
par) = r(r — Y)p* + rp = тар? + p(l — р); 
bal) = rp? + Sr?p* + тр; 
ua(r) = rpt + 6r'9p* + grips + Tp. 


6* 
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Similarly, we derive 
mir) = тра; 
mr) = rpa(g* — £^) = rpa(a — р); 
mr) = 3r(r — 1)p*q* + тра(1 — Зра) 
= Зуара + тра(1 — бр). 
Another result we may usefully invoke at a later stage is the distribution of the difference 


between independent unit samples from the same universe. We may write the g.f. of the zero 


moment of the u.s.d. as 
g-0 
w= S. Us. 6^ (Би)о = рь 


z-0 


Since we may regard the paired score difference as the sum of positive and negative scores 
distributed in the same way, we may write for the corresponding g.f. of the negative score 
distribution 


v= osu .€**; (Dig), = (— 1)¥ н. 


z=0 
The m.g.f. of the difference distribution in accordance with the product rule is then uv, and 
px(d) = (Dj. ио). 
By successive differentiation we have _ 
D,uv = uDw + Юи ; 
Diuv = ир} ю + 2D,u . Dyv + vDju ; 
Diuv = ио + 3D,u . Dio + 3Dju . Dyo + vDju ; 
Djuv = uDjp + 4Dyu . Div + 6Dju . Dv + ADju . Dyv + Ри. 


In these expressions when h = 0 
u=1=0; D= ja Ро; Diu = m = Div; 
Dju = из = — Div; Diu = py = Dp. 


We therefore obtain 
мій) = 0 = ud); pd) = 2ш; шій) = 294 + Bus. 


Since the mean of the distribution is zero, the mean moments and zero moments are identical. 
So we have 


md) = 2m,; md) — 0; md) = 2m, + бт. 


More generally, we see by the same procedure that the odd moments of the paired difference 
distribution from the same universe are all zero and the even moments are the same as those of 
the 2-fold sample. If the u.s.d. is symmetrical, the odd moments of the 2-fold sample score-sum 
distribution are also zero, as is true of a universe if successive terms of the expansion (3 + })* 
define the score frequencies. As we have then seen, the frequencies of the 2-fold sample score- 
sum in the range 0, 1, 2 . . . 2a then tally with successive terms of ($ + 4). We thus arrive 
at the following conclusion : if the binomial (3 + 4)* defines the u.s.d. in the range 0 to a, the 


MORE ABOUT MOMENTS 589 


binomial (4 + 4)? defines the distribution of both the pair-score difference with range — а 
to + a and of the pair-score sum with range 0 to 2a. If the scores of the u.s.d. increase by 
Ax from m to m + aAx, those of the pair-difference increase by Ax from — aAx to + aAx and 
those of the pair-score sum from 2m to 2m + 2a4x with the same increment. 

Throughout this section our concern has been with discrete distributions. We may extend 
our scope, if we recall remarks at the end of 14.01. The frequency (f+) of a score x is 
numerically equivalent to the corresponding area of the histogram of unit area, being y,Ax if 
Ya is the height and Ax the base whose midpoint is x. We may thus speak of Д» = Ja. Ax as 
the frequency of a score in the range (x + $Ах). When Ax becomes indefinitely small, we 
may write y = у, as the ordinate at x and у. бх as the frequency of the score х in the range 
х +4dx. We then have 


Ўл | y.dx; 
0 
TEM 


= = 
Ўл. | y. &^ . dx. 
о 9 


The last expression is the generating function of the zero moments, when all score values are 
positive. If Y . dX is the frequency of the score deviation X in the interval X + 4dX, the g.f. 
of the mean moments is 


o 
| Y.e™. dX. 
-0 
When the function Y is symmetrical we may write this as 


[v en ax. 
0 


Such expressions are of no use for determining moments unless they are integrable, as is true 
when the distribution is normal (vide 14.04 below). A class of continuous distributions of special 
importance is that of Gamma variates specified as such in accordance with the definition of the 
Gamma function, viz. : 


© л poo 
| 9.091. 48 = гш) so that ns] p gud 
A 0 


Thus the ordinate equation of a Gamma variate is 


poet t 


РЕТКА: 
The g.f. of the zero moments is therefore 
Re [ ка K L 
| eM itt des | Oe 1 des 
T(n) Jo T(n) Jo 


т To) 


reo A 
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In this expression we may expand (k — h)" by the binomial pang vis. : 


n(n + 1)(п + 
3! 


n(n + pie п-2у2 ц 


(k — Ву" = k” + nk AR 4 Nina} 522095 


r=0 _ тую 
б> Ct 


r=0 


kh s 


(п + 2/9 4-942 (п + 3j 4-3] 


DG, = nk + (n + 12? &*4 4 2i E 3l etc. ; 
L (4) 5-472 
DjG, = (n + IPK? + (n + 2) 4 = ie e 
455-542 
G, = (n + 29k + (n 4- Зума + U Y er. 


When h = 0 we thus get 
= nk; py = (n + 194€? ; п == (n + 2) ete. 
We shall obtain this result by another method in Chapter 15. 


EXERCISE 14.02 
1. Find the first 4 zero and mean moments of the mean score distribution of the 3-fold toss of a 
tetrahedral die with face scores 
(i) 1,2, 3,4. 
(ii) 3, 6, 9, 12. 
(iii) 1, 2, 2, 3. 
(iv) 2, 7, 7, 12. 
2. Find the same moments for the distribution of both the raw-score and proportionate-score 
difference w.r.t. 3-fold and 2-fold tosses of each of the above. 
9. Investigate the first 4 mean moments of the distribution of the mean score of samples from a 
3-class universe with the following u.s.d. scores: — 1, 0, + 1, frequencies pa, Py, Pe 
4. Find general expressions for the first six Pearson coefficients (£, to B,) of the u.s.d. of the above 
for the symmetrical case when p, = р, (for definition of B, to B, , see 14.04 below). 
5. Find expressions for the 6th and 8th mean moments of the 6-fold sample from the symmetrical 
3-class universe and hence for the corresponding values of B, and B, (see 14.04). 
6. Derive expressions for the first 8 moments of the score difference distribution of 6-fold samples 


from the symmetrical 3-class universe and show that they are equal to the moments of the distribution 
of the sum of the difference between 6 pairs of unit samples. 


7. Tabulate results of the above for pa = pe = $, 1, 1, 4, з; and check all results by using the 
probability generating functions of the distribution (see Ex. 6, 11.09). 


8. Show that the m.g.f. of a Poisson system (vide Chapter 10 of Vol. I) for 7 unit samples from 


т 2-class universes is 
ier 


Gu) — TT (ре?) 


i=l 


Check this result numerically for samples of 3 by putting f, =}, 5, = $, Р = {. 
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9. If we have two series of urns with parameters f, , , and p, , ; definitive of the u.s.d., show that 
the m.g.f. of the mean of r paired differences in sampling with replacement is 
i-r 
Gu) = TT (467 - Bi Ce) 
i21 
in which expression 
А, = paises Bom Pacis Doc Garis Gti Com Posi dosi 
10. For the last set-up cite the value of B, for the 3-fold sample of paired differences when 
Ьь.‹= Е.ра. е 


14.03 FACTORIAL MOMENTS 


We can sometimes sidestep difficulties w.r.t. derivation or computation of moments, more espe- 
cially moments of a discrete distribution, by recourse to analogous indices in which factorials 
take the place of ordinary powers of the score x or of its deviation X = (x — M) from the mean. 
Thus we define zero and mean factorial moments as follows : 


Lene aad та D Yr X9 о а x À 


Here we concern ourselves solely with the zero factorial moments, recalling that 


П 

s" аби 108—2)... (В) = Lu (ii) 
For the first 8 powers we have 

xo = x; 

x =x; 

x) = x? — З? + 2x; 

x) — х* — 6x3 + 115° — 6x; 

a(9 — x5 — 10x4 + 35x9 — 50x? + 24x; 

09) = x* — 15x5 + 85x! — 225x3 + 274x* — 120x ; 

x — x! — 215 + 175х5 — 735x* + 1624x? — 17643? + 720x ; 

a9) = x8 — 28x" + 3224^ — 196015 + 6769x* — 13132x* + 13068x? — 5040x. 


Ак) 


Since we can always express x“ in the form 
aL BR RR Pts. BK x 


r-k-1 


= 23 Ci Ж жы 
r=0 
r-k-1 
su Ep] = У IK EQ) 
r=0 
"0-1 
=> > *Kypxr 
r=0 


From the relations cited above 
Hay = E(x) = m; 
шщ» = EG?) — E(x) = po — m ; 
Ma) = E(x*) — 3E(x*) + 2E(x) = ps — Зи» + 2p, etc. 
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We can thus derive any ordinary moment as a series of zero factorial moments, the first eight 
being 

а = Fas 

Ha = Щз + Bayi 

из = щз + 3p + Ha 5 

ш = ау + 88 + Te + Ша); 

Bs = pes) + 10а + 25щ») + 15щ» + a 5 

ра = шо + 15щь + 65р) + 90а + Sle + а ; 

ра = що + 21щв) + 140щь + 35014, + 30199 + 6353 + на); 

из = pa) + 281 + 266p + 105015 + 1701 + 9661 + 127] + Bay 

The advantage of this arises from the fact that simple general expressions for factorial 


moments may be obtainable, when it is not possible to derive simple expressions for moments 
of the more familiar sort. The following examples will show that this is зо: 


(a) The Poisson Distribution 
For this distribution with mean M and range x = 0 to co 


eM 
Jas "Ape 
2, MOD 
-M zm 
шы = € e xl (ii) 
In virtue of (ii) we may write 
Mex) M? м*.М=* 
x -ìi Oe! 
D М*-* 
* = еМ — З А s 
os pm = E Zam b (iv) 


All terms in the summation vanish if x < k, so that we are concerned only with x = k, k + 1, 


®+2... @, ie. 
ess мМ M M M 


Zom o a tw 
м oM 
—bITMa4- by 
Lat 
Whence by substitution in (iv) 
щы = M* . 5 3 5 ; . . @) 


Hence we derive 
= pay = М; 
ра = що + pay = M+ М; 
из = ща + Зщз + шо = M* + ЗМ? + М; 
Ja = що + Op + The а = M* + 6М° + 7M? + М. 
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The mean moments are obtainable from the zero moments by recourse to the now familiar 
formulae, so that 
m, = М = тз; m, = M(14- ЗМ); 


1 1 ; 
= апд В.=3+ 7: : x i . (vi) 
For the Poisson distribution we thus have the relation 


В. =3+ В, А . c . б . (vii) 


The reader will recall (6.08 in Vol. I) that the Type III distribution is more leptokurtic for 
the same measure of skewness, since 


вва и ууш) 
By proceeding іп the same way we derive, for the higher Pearson coefficients (р. 599), 
10 1 25 1 r 
Bat m = 19 +t у . (ix) 
105 56 1 490 119 1 
bB = у t mt m 567105 + у amo 


In Chapter 5 of Vol. I, we have seen that the Poisson approaches the normal distribution 
when M > 9. It is instructive to compare the Pearson coefficients of the normal with those 
of the Poisson distribution when M = 1, 10 and 100. 


B Ba B, В. Bs Bs 
Poison M—1 . . 10 40 110 410 162-0 715-0 
» M=10 . OST 31 1-01 17:51 11-06 155-191 
» M=100. . 001 3:01 031001 15-2501 1.0556 109-91 
Normal . . 00 30 0-0 15-0 0-0 105-0 


(b) The Rectangular Distribution 


If the universe is n-fold with scores 1, 2, 8 . . . n, 
tan х0 
Bay = = ru E : E : : - &) 
z=1 
By (v) in 11.07 
^S um (n+1)* (п + 1)n(n — 1)*-? | 
E (k + 1) k+1 Е 
(n + (n — 1)%-0 E 
ea = т . . . T . д (ЖШ) 
Evidently, 
n+1 т —1 
OY оа LO ae ree 
nus -A mos 2 
(nt = 1н —2). (nt — (nt —5n +8) oto, 


зу 4 Puy 5 
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From these, and by means of the next four of the series, we derive the following values 
for the ordinary zero and mean moments : 


_ (w+ 1n 4-1) е1 
andis з m= T 
ү: 2 
Из = cs m,=0 
(n + 1)(2n + 1)(3n? + 3n — 1) m = 2 = Dv — 7) 
30 eo UD 
1y(2m + 2n — 1 c 
ME EEEE udi 
oua Dn + 18m + Gn? — 3n + 1) m, = Ê — Dn — 18r? + 31) 
ла 42 nd 1344 
n(n + 1)3n* + 65? — n? — 4n + 2) 
24 m; = 0 
(n--1)(2n4- 1)(5n*-- 15n5--5n*— 15n*?—n*--9n—3) (n2— 1)(5n5—55n2-2395*—381) 
Аў 90 УШ; 11520 4 


Hence we derive the following exact expressions for Pearson coefficients of even order, all odd 
ones being of zero value : 


9 12 27 108 144 D 
Bis бт), P 7 = e m estis 
72 , 196 1728 s 
&-9—-4—1t5m—IR BPI ^ EU 
(c) A Binomial Distribution 
If the definitive binomial of the raw score (x) distribution is (р + 4)" 
sr 
Ha = 5 BL) ax did . . . . . (xiv) 


z-0 
"The derivation of an appropriate expression is easy by successive partial differentiation of the 
binomial series. Thus 


M ye " 
erate = ap^ + 9)"; 


5h às — Irie p? 29 = r(r — Y(p + gy 7?. 


More generally we thus derive 
ye m Ы А 
pL "ep qq es ap +4); 


EX XL =p + gr-* — r9; 
rj 


‚ 

(0), = (k) pk 

© Ear peg = rtp 
0° 
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Alternatively, we may proceed as follows : 


» rr —k! x! 

ам) 

тыр" 7x HE are p EST 
= pr (r — ky! gp-kgr-z 


(т х) (x — E? 7 
If we put и = (x — k) and v = (r — k) in the above so that (r — x) = (v — u) 


gr wae 


Te Ak) — QUAE jag? -u 
таре" r P 2 ae сай? . 
Since и! is infinite when и is negative, all terms in the range и = — 1 to и = — k vanish, and 
z-r 
Ak) — pik). Ak) yk, 
PI gfx) = ap P ial ^ q*-* = "рр + gy 
zor 
b3 Ti purto = aai gA 
2—0 
во = р. : Е 5 A : : 5 . (ху) 
Hence we derive the еей expressions for the zero moments : 
ра = 7° + трд; 


Ha = P? + 3rp'q + rpa(a — P); 
Ha = т*р* + блар? + rq — 11р) + тра(1 — 6p9). 
The corresponding mean moments are 


Ms = трд; 
ms = тра(9 — Р); 
m, = 3r*p*q? + rpq(1 — брд) - а ` б . (xvi) 
We derive in the same way the higher even moments, e.g. 
m, = Yr pg? + Sriphq(5 — 26pq) + rpq(1 — 30р + 120g) >. (xvii) 


EXERCISE 14.03 


1. Determine the first 4 factorial moments of the unit, 2-fold, 3-fold and 4-fold sample distribu- 
tions of an infinite universe of score values 1, 2, 3 (a) in the ratio 1 :2: 1; (b) in the ratio 1:4 : 1. 


2. From the foregoing results obtain the first four ordinary moments about the mean, and 
B, and f, for each distribution. 


8. Repeat the foregoing exercises for score values of — 1, 0 and + 1 in the same ratios. Compare 
the results. 


1404 THE NORMAL DISTRIBUTION 


The only tabulated sample distribution we have used in Vol. I as a sufficiently satisfactory 
descriptive function in the sense defined in 14.01 is the normal. When we seek to establish in 
what sense the normal integral provides a satisfactory fit to an exactly definable distribution which 
involves recourse to laborious computation, it is important to be clear about the significance 
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level at which we deem correspondence to be satisfactory. Accordingly, we should remind 
ourselves that tables of the integral or ordinate of the normal distribution always refer to the 
standard score (c), i.e. the ratio of the deviation X — (x — M) of the score from its mean to 
the standard deviation of the score distribution : 


2 X : 
с=—==— š : : - . PE C] 
Meo @ 
"The variance of the standard score is by definition : 


У, = (2) = Jax) ; 


2203, ZEN oe 1 


"This is why we speak of the distribution of the normal standard score as that of the normal variate 
of unit variance. When we speak of a level of significance in the same context we merely refer 
to the numerical value of the standard score. If our concern is to establish at what significance 
level the normal gives an adequate approximation of the sum of the terms of a binomial dis- 
tribution, we presuppose a criterion of adequacy (e.g. an error not exceeding 10 per cent.) and 
we must thus base our comparison on standard scores. 

For a distribution of raw-scores (x) from 0 to r defined by terms of the binomial (9 + р)" 
the variance is rpg and the mean is rp. In standard form the score is therefore 


da A 
Уч 
Thus we define standard scores of the binomial distributions below as follows : 
р т с 
(х — 8) 
i 16 5 
2(x — 9, 
1 5 (x — 9) 
3v3 
(x —5) 
9: 
t 25 5 
(х — 10) 
ty 100 3 


1f our only object is to compare frequencies, no other precaution calls for comment. However, 
our main concern in statistics is with summation of frequencies ; and we use the table of the 
normal integral defining the area under the curve from — оо (or zero) up to the assigned sig- 
nificance level. We then have to remember to make the half interval correction of (v) in 14.01, 
as explained more fully in Chapter З of Vol. I (p. 112). If the score increases by unit steps 
(Ax — 1), the boundaries of the base of the histogram enclosing an area which corresponds 
to the sum of frequencies of score deviations from X = a up to X = b are respectively at (a — 1) 
and (b + 3). Thus the appropriate X co-ordinates of the fitting curve which approximately 
goes through the midpoint of the uppermost margin of the histogram columns are for X and 
— X respectively (X + 3) and — (X + 4). More generally, if the score increases by Ax the 
boundaries of the base of the histogram enclosing an area which corresponds to the sum of 
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score deviations from X = a up to X = b are at (a — }Ax) and (b + ^x). The appropriate 
X co-ordinates of the fitting curve for X and — X respectively are then (X + Лх) and 
— (X + 49). 
To express our score in standard form referable to a mean M and variance o? with due 
regard to this correction, we must distinguish three cases : 
(i) to sum frequencies from — X to oo or from — co to — X, we write 
ea HM + HAs), 
Er mdi 
(ii) to sum frequencies from — co to X or from X to oo 
on M 4л), 
i ; 
(iii) to sum frequencies in the range + X, we write 


с 


= 


Score-sum Distribution of Unit Variance. Їп Chapter 16 we shall have to make extensive 
use of a property of score distributions so defined that the variance is unity ; and we may 
appropriately dispose of it in this context. Suppose a player records as his score w the sum of 
the individual results xa, x, . . . x, of single trials from л identical dice weighted by a particular 
constant (a, b . . . n) which need not be positive, i.e. 

$74.X,4-5.2x HC. ko. o o fox. 
This is, of course, equivalent to renumbering the score faces by an appropriate scalar change 
Za = а. Xas Za = D. ху, 80 that 
w = 2, | Zo F Ze o o + Bue 
The effect of this scalar change is, of course, 
V(z,)-— V (x4); V(zy) = ФИ(ху), ete. 
Tn virtue of independence, we may write the variance of the score-sum distribution as 
V, = V(z;) + Vz + (ж)... + V(z,) 
= aV (xa) + BV (x5) + c*V(x,) . . . nV (xn). 
If the dice are identical V(x.) = V(x») = V(x,), etc. = V,, and 
И = (а 0 4 с... nV, E 5 5 . (ш) 
In this expression V, is the variance of the unit sample (single toss) distribution of the die, and 
we make the variance of the player's score distribution identical with it if the rule of the game 


prescribes that 
ё ++... n=l . . А s x: (iv) 
If we vary the rule of the game by prescribing that the player records the weighted average of 
the standard scores of the n trials 
3050.6, -- У Cys 


It follows from (iii) that 
Ve= а 0 4... т . В . : 209 
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Thus V „is then itself a score of unit variance, if 

++... т=1 * > E 5 © (vi) 
For example, V „ = 1 if the rule of the game prescribes either of the following systems of scoring 


w = фс, + ey + bee + 36; 
w= {с„ — he, — = 


Standard Score and Scale. Since moments of a distribution depend on the scale of the score 
increment, we can make them comparable with those of the normal curve of unit variance only 
if we choose our scale accordingly. If a discrete score z — kx, z increases by increments 
Az = kAx, and M, = kM,; but V, = АУ, and o, = ko,, whence 

z— M, kx—M; x—M, 
7. koz 9. 


Example 1.—For a 2-class universe p = 0-1 and g = 0:9. Find the standard score corresponding 
to a raw score x = 15 and proportionate score u = 0-15 referable to a replacement sample of 100. 

The definitive binomial of the 100-fold sample is (59; + 345)! so that V, = rpg = 9 and о, = 3, 
the mean raw-score is M, = 10. Hence the standardised raw-score is 2(15 — 10) = $. The mean 


proportionate score М, = 0-1, and V, м бй whence c, = 0:03. The standardised propor- 


tionate score is 
015—01 5 
0-08 3 

Example 2.—Two tetrahedral dice have face scores: (a) 1, 2, 2, 3; (b) 3, 5, 5, 7. Why are the 
standard scores respectively corresponding to score sums of 7 and 17 in a 3-fold toss equivalent ? 

The distribution of the 3-fold toss accords with successive terms of (} + 3 + 1)? = (3 + $), the 
general term of which is 2~*.6(,). This corresponds to scores of: (a) 3 + x, (b) 9 + 2x. For the 
first distribution, the scale is unity (Ax = 1) and for the second, Ax = 2. The variances are 6(2) = 2 
апа 22.2 — 6. The means are 6 and 15 respectively and the standard scores are therefore 
7—6 aw. 17—15 as 
ES à»; (0) ——-(Q0*. 


v6 
Note that the scores have the same frequency since x — 4 in the general term of the binomial if: 
(a) 8-- x —7; (b) 9 + 2x — 17. 
Thus the effect of standardising the score is to make both the scale and the origin of the 
distribution irrelevant. This circumstance throws light on the build-up of Pearson’s moment 


coefficients of skewness and kurtosis (flatness), which we define so that they do not depend on 
the scale of the distribution. For any moment of a standard score distribution we may write 


wort) 52 


Thus Pearson’s coefficient of kurtosis (see Chapter 6, Vol. I) is simply the 4th moment of the 
standard score distribution, i.e. 


(a) 


ао, 


т 
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More generally, we define higher Pearson moments of even order as even moments of the 
standard score distribution, e.g. 
Bs = = = mc); Bs = — = тс) . . . - (viii) 
Pearson's first coefficient of odd order is the square of the third moment of the standard score 
distribution, being 
ms 
В, = mÈ = mic). 


Squaring makes it irrelevant whether the mode lies right or left of the mean. The definition 
of the next two coefficients of odd order is 


Bo = 


IN 


(ix) 


In the light of previous remarks, we thus see that Pearson's coefficients embody a method 
of comparison of distributions eliminating distortion arising from difference of scale. The 
symbolism he introduced is confusing for more than one reason. It would be preferable 
to label coefficients of even order so that the subscript would be that of the corresponding 
moment of the standard score distribution; and the definition of coefficients of odd order 
is doubly exceptionable. By defining B, as the square of the third moment of the standard 
score distribution we eliminate the sign of the skewness, so that one distribution otherwise 
identical with another may be its mirror image; and the definition of higher coefficients of 
odd order has a disadvantage aside from the fact that it is inconsistent with the pattern of the 
coefficients of even order. Though they must all vanish if the distribution is symmetrical, 
the converse is not true. They must vanish if m, = 0, and this is consistent with the possi- 
bility that the distribution is not symmetrical, since higher moments of odd order need not 
then vanish. 

For the normal distribution it suffices to define the values of Pearson's coefficients of even 
order, since all moments of odd order must vanish in virtue of symmetry. We shall therefore 
write 


malc) = E(c*) = =| Gt we ds 


Since the c-distribution is symmetrical 


mac) -—- pudo ge 


М2т Jo 
"To evaluate this integral, we now substitute с? = C so that 
dc 
dc = — + 
c= 26° -dC = 1C-*.4C, 


© 
` male) == poi c ORE, А 
9 


NV 2n 


SD : 
= fal esce. Ex M ada 
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The integral in the last expression is a Gamma function, whose value is by (xi) in 6.05 (Vol. I) 
T(k--3, 

2*T(k + 3) A 

Te : « $ 7 - (xi) 


тс) = 
We have already seen (p. 249, Vol. I) that : 
газ) = #ГФ); T(28) = 3.378); 
re} =#.#.3%Г@); Г) = $.$. 8.310». 


1.3.5... (2k — 1) 
LISE ra). 


In general therefore 
I(k-4-3)-— 
By substitution in (xi) we thus derive 
т.с) = 1.3.5... (2k — 1). 
By setting k = 1, 2, etc. in the above we therefore derive 
mc) = 1; m,(c) = 3; m(c) = 15; m,(c) = 105. 
Hence from (vii) and (viii) 
В.=3; В =15;Ь=15. . . . . (ii) 
The Square Normal Standard Score. We may here pause to notice that the foregoing 
examination of the moments of the distribution of the normal score of unit variance leads at once 
to the derivation of the zero moments of the distribution of its square (C = сї). By definition 
the kth zero moment of the C-distribution is 
px(c) = E(C*) = Е(‹®%®), 
oe шс?) = malc) . ы У à , . (xiii) 
oe p(C) = 1; nC) = 3; (C) = 15; ш(С) = 105, etc. 
We shall have occasion to examine the meaning of the results last stated more fully in 15.02. 


Meanwhile, the reader may with profit recall the Type III variate (p. 257, Vol. I) whose p.d. 
equation is 


17 
f -Ap "cc T VPE PES . (xiv) 
The Ath zero moment of the above distribution is 
à fo 
px(C) = of аста СМС; 
LJ 


+ (o 
С) = | g- X C9 9-1, qc, 


0 
"The above is identical with (x), whence 


(С) = malo). 


ШС) = mc?) E A 5 5 ` . (xv) 
Thus (xiv) defines the distribution whose moments of any order are identical with those of the 
distribution of a square normal standard score, as we shall establish by a different procedure 
in 15.02 below. 


We may therefore write 
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M.G.F. of the Normal Distribution. From (vii)-(viii) above, we easily obtain the moments 
of the normal distribution when the variance is not unity. We may express (vii)-(viii) and (xii) 


in the form 


B. эк+з 
2k Vert 


and fa = (2k + 1)(2k 


Whence by putting k = 0, 1, 2, etc. we have the following results : 


1087+ 


ЗИ; m, = 15V? ; m, 


m=V; m 


ТОБ 9) Бов 


бот 


+ (xvi) 


We shall later make use of the moment generating function to derive certain useful properties 


of normal distributions. 


does in fact generate the moments defined by (xvi) : 


By expansion in the usual way 
pM OF 


С. = а a 3 . . 


зді зө Vans Vey 
! } etc. 


Gu шар р 


Whence we obtain 


4. 


ова шет 82:61: ^ 


Vh? Vhè У Vh А үз? Я 
DG, + -z - 3 B Hagg o te 
BV SV 7р6 
D$G, = V4 9 : 3 teg EH 
8, гарь 
АЛА zx: eie. 
2 8 
342 ahi 
DiG, = gy: 4. 181% pore ee 
2 8 
ns 
DIG, = 15ys + 57% TR 
Sih? 
DIG, = 15V? + € 2 a eet anette 


Whence we have 
(П.С) = 0; 
(Dj . Gu)nao = 3V* ; 


(Di Gy = 0; 


The derivation of (xvii) is as follows. 


(Dj Gu)nno =V; (03. Gu)nno = 0; 
(DE. Gho =0; (DE. С = 15; 
(D$. G,)rmo = 105V“ etc. 

By definition, 


1 ipe 
E) E e dX 
VY 22V J -o 


(Xt — 2АХ + Уе) ayy 


L iis dX 
= Уту). “Р 2y : 
fave po (X — Vh} 
= vas]. ben бус г, 


Before we derive its form, we may show that the following function 


. (xvii) 
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If we put (X — VA) = z, so that dz = dX 


give [= 2 
-3y 
G, f e * dz, 
-œo 


ПУЕ 
vb. ah 
М2тЁ 


In this expression 


-® 
ОЕ Уу МЫ 


"Thus the m.g.f. of the score-sum (and hence of the mean score with appropriate change of scale) 
of r unit samples taken from the same normal universe is 
Ст errr 
E А 


This is the m.g.f. of a normal distribution of variance rV. That of the mean score is the m.g.f. 
of a normal distribution of variance rV + 72 = V +r. The m.g.f. of the score-sum of two 
samples from normal universes with u.s.d. variance V, and V, is 

еа? AVE — AO YR 


This is the m.g.f. of a normal distribution of variance (V, + Vj). In virtue of symmetry 
(11.08, p. 473) it is also that of the distribution of the score difference. We may sum up these 
results as follows : 


(i) If the u.s.d. of a universe is normal with variance V, the distribution of the score-sum 
of the a-fold sample is normal with variance aV and that of the mean score is normal 
with variance V + a; 

(ii) the distribution of the sum and difference of a-fold and 5-fold samples from the same 
normal universe is normal with variance (a + b)V = V, + V. 


14.05 MOMENTS OF THE DISTRIBUTION OF THE MEAN 


In Chapter 7 of Vol. I we have seen that it is always possible to express in the form V, = t . V, 
the variance (V;) of the random t-fold sample distribution of the score-sum in terms of the 
variance V, of the unit sample distribution. We shall now employ results obtained in 11.02— 
11.03 to determine the value of higher mean moments of the distribution of the score-sum (and 
hence of the mean score) of t-fold samples in terms of the mean moments of the unit sampling 
distribution of the parent universe ; and hence to establish an important conclusion with refer- 
ence to the distribution of sample means, already foreshadowed in 14.02. Our assumptions 
are: (i) that the samples are random, i.e. that choice of one item is independent of that of another ; 
(ii) that none of the moments concerned is infinite. The last condition is true of any dis- 
tribution of discrete scores. In virtue of (i), the relevant formulae are those derived by 
application of the product rule. So we can derive the ensuing results by recourse to generating 
functions, as indicated in 14.02. Here we shall do so by a more elementary procedure. 

It will be convenient to denote the kth mean moment of the unit sampling distribution by 
my and that of the t-fold score-sum by m;(t). We now recall definitions given in 11.03, and write 
the 3rd moment of the distribution of the score-sum of the (a + 6)-fold sample in terms of those 
of the a-fold and 5-fold samples as 


ma + b) = E(a + b — M, + My? = E(a — M, + 5 — My? 
= E(a — M, + 3E(a — M,(b — M,) + ЗЕ(а — M,)(b — My + E(b — My 
= m.(a) + 3m4a) . m (b) + Sma) . ту) + m4). 
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Since the first mean moment of any distribution is zero 
mj(a + b) = та) + туф), 

т + 1) = m,(t) + ms. 

Whence we have m,(2) = 2m;, m,(3) = 3m,, and in general 
m(t) = t . ms. 
In the same way we may write 
m(t + 1) = m(t) + Amy(t) . m, + 6my(t) . m, + 4m,(t) . ms + m, 
= mt) + 6my(t) . ma + ms. 


Whence we derive 
m,(2) = 2m, + 6m3; m,(3) = 3m, + 18m}; 


т\(4) = 4m, + 36m ; m,(5) = 5m, + 60m. 


And in general 
m(t) = t . m, + 3t m3. 


Similarly we may derive 
m(t + 1) = m(t) + 10m,(t) . ma + 10ma(t) . т; + ms. 
Whence by iteration, we obtain 
m;(2) = 2m; + 20m, . т»; m3) = 3m; + 60m, . ms; 
m(4) = 4m; + 120m, . тз; ms(5) = 5m; + 200m, . ms. 


And in general 
m(t) = t . m; + 10t 9 m, . ma. 


We may derive similar expressions involving figurate number coefficients for higher mean 
moments in the same way, and may tabulate the first eight as follows : 


m,(t) — 0 

mt) = t . ma Y А : * : . * Е > A * EO 
m(t) = t. my 3 f : à E s А : х н : è . (i) 
vcre ROMS ЖЕНЕТ UE wa s s „'{Ш) 
m(t) = t. m; + Y0t?m,. m, . 2 E ч М ^ : Я - . (iv) 
m(t) = t . mg + 15t? m, . m, + 10r m$ + 15m . = : А ` n Tet) 
m(t) = 1. m; + 21? m; . m, + 35t ту. тз + 105t'm,.mz . ә A е . (vi) 


m,(t) = t . mg + 28t'?m, . m, + 56129 m; . тз + 35t? mj 
+ 2101.9, . тї + 280t'9 m3 . m, + 105¢ m$ (vii) 
To determine the mean moments of the corresponding mean score or proportionate score, 
it is merely necessary to make the appropriate scalar change, viz. : 


AEJ inr 


The scalar factor а cancels out in the denominator and numerator of the Pearson f-coefficients. 
So Pearson coefficients of the same order are identical for score-sum and score-mean or pro- 
portionate-score distributions ; and we now have all the data for expressing Pearson coefficients 
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of the score-sum or mean-score distribution in terms of those of the distribution of the unit 
sample. We shall write the Pearson coefficient of order п for the mean-score or score-sum dis- 
tribution of the ¢-fold sample as ¿n and that of the unit sample as В. Ву definition, the 
values for odd and even order are respectively : 


Odd 
Pana ES ова н. 
Even 
Ва ба: ара ты, 
By recourse to (i)-(vii) above, we therefore derive 
ob = (RS = rA: 
sc muah O 
In this way we may proceed to tabulate results for the first 6 Pearson coefficients as 
"T зу сы, “ы О 
afe 84 0-2 7 „Тек С S ME. 
«Вз = De e + 5 2a 8 8. . _ 
ЕРЕ = 1-с = 5 
ae CER eee : a 146 . a (xii) 
of, = 1054 22 Пар, a DB, , 2100 — 19.9 
, 286 = NG. — 3 , @— ув, - 15) 46309 "e 


We may thus say that (o, Ês» (of; all approach zero for large values of t and 
P» Po (Bs respectively approach limits of 3, 15 and 105. On the assumption that 
none of the moments involved is infinite, the Pearson f coefficients of any order w.r.t. the 
distribution of the score-sum or mean score of random t-fold samples from any universe there- 
fore approach limiting values identical with those of the corresponding В coefficients of the normal 
distribution. Accordingly, a normal distribution is suitable to describe the distribution of the 
t-fold sample mean value of any score regardless of its own unit sampling distribution, if the 
sample size t is sufficiently large, and the moments of the unit sample distribution are all finite 
(or zero). 

Certain distributions already dealt with in Vol. I will provide occasion for illustration of 
the implications of the foregoing theorem. 
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(a) Poisson Universe 


That of the unit sample is a highly skew distribution which is also leptokurtic (B, >3), 
ie. steeper in the region of the mode than the normal. For successive values in the range 
x=0,1,2..., the frequency equation is 

eMM* 


xl 


The skewness depends on the single parameter in the above, i.e. the mean value (M) of the 
score x. From the results already touched on in Chapter 6 of Vol. I, and set forth more 
fully in (x) of 14.03, we obtain the following values for the Pearson coefficients, when M = 1: 


ай =1; mBi—4; од = 11; qf = 41. 


By recourse to the preceding theorem, we obtain for the distribution of the score mean of 10-fold 
and 20-fold samples, 


Sample size Ay Bs В, By 
10 0-10 3-10 1-01 17-51 
20 0:05 3:05 0:5025 1616 
Normal 0-0 3:0 0:0 150 


(b) Rectangular Universe 


For an n-fold universe of score values 1, 2,3... n, the expression for the score-frequency of 
the unit sample is 


p. 
MESA 
The odd mean moments are all of zero value, as demonstrated on p. 594, and 
в 9 dz в 27 108 , i” | 
ai — 5 = $63 — 1)! aA — 7 —74$—1  7*-—1' 
73 1296 1728 


о 9 а 55 —1f Bm —1* 
For the 6-fold (n — 6) rectangular universe of the ordinary cubical die we therefore have 
аба = 1731; (gf, = 3:422; (yf, = 7:146. 


For the mean score distribution of the t-fold toss, we obtain from the foregoing theorem, 


No. of tosses B В, Bs Bi Bs Bs 
6 0 2-789 0 12-036 0 65-103 
12 0 2:895 0 13-466 0 84-586 
18 0 2.930 0 13-966 0 91-002 
Normal 0 30 0 150 0 105-0 


(c) A Binomial Universe 


The determination of the higher moments of the Binomial distribution, though elementary, 
is somewhat laborious by more usual methods. The relations established above permit us to 
compute both moments and Pearson coefficients by a shorter route. The procedure depends 
on a theorem established in Chapter 7 of Vol. I, viz. : if successive terms of the binomial (p + q)* 
define the unit sample score distribution of an (a +°1)-fold universe, successive terms of the 
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binomial (p + 4)** define the random distribution of the score-sum or mean score of the ?-fold 
sample therefrom. If we make а = 1, denoting by (уут the Ath mean moment of the dis- 
tribution whose definitive binomial is (p + q)', the corresponding moment my is that of the 
distribution of the t-fold sample score in the taxonomic domain of a binary universe. For 
its unit sample the mean is then p and the distribution is simply 


Raw Score (x) . 5 E SAND 1 
Score Deviation . . . —p (1—3)—4 
Frequency (y) . : à mod $ 


Thus the kth mean moment of the unit sample distribution is 
my = q(— py + pë. 
Whence we derive 
т» = 9° + pg* = palp + ч) = pa 
ms = pq’ — ар? = pala? — Р?) = pala — Р)(0 + P) = pala — Р); 
m, = qp* + рд = pa(p? + q*) = pa(p* — pa + 4) = pall — Зрд) ; 
ms = pg? — 4р5 = pq(q* — p") = pala? — Pg + Р?) = pala — PY — 2р0) ; 
m, = gp° + pq’ = pq(1 — Sp'q — 10p*g* — 10p*g* — Spq*) = pa(1 — 5pg + 5р?) ; 
m; = pq’ — qp? = pala — p^) = Pal — PG? + р") = pala — Р)(1 — paY1 — 3po) ; 
ms = qp* + pg* = pafl — 7ра(1 — 2pq + рф). 
We may write the general formulae for the Pearson coefficients as follows : 
B. тз. т (9 — Р)(92* — p™) А 
«Рк тїз EZ H 


870-1 gr 
wÊ- = == ay 


Hence we get 


— р)? 1—3 
af = «с ; wb: = ү? M 
Bs = =p 2р4). В. ims 5р4 + Sp'g* . 
a) re a) Pe B 
Bs (a — P)O — pay — 3pq) | m 1 — 7р4 + 14p*g* — 7р3 
a) pe 5 чу pe 
We thus obtain 
[DA = ex 5 
— 6i 
(By = 3 + M 
uestes itae уа: 
(ys Bp 
c 541 30р9(1 — 4рд) + 5tpq(5 түз. 


2р 
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s (4 — PY. — рд)(1 — Зра) + 7(t — 1)р4(8 — 51pg + 15tpq)} | 


арф 
Ins, 2105 1 — 704(1 p l6p*q*) 
7(t — 1) 
zs BP [17 — 238pg + 704p*q? + 10tpq(7 — 34pq)]. 
When ? = {= ф 


ai = 0; вг = 1; 
Bs = 0; ша = 1; 
ms = 0; аг = 1. 


In Chapter 3 of Vol. I we have seen that the normal is а good fitting curve at the 20 level for the 
discrete distributions whose definitive binomials are respectively 


(а) @ + 4)'*; (0) Go + 3). 
From the above values for the Pearson coefficients of the 2-class distribution defined by the 


unit binomial ($ + 3), we obtain the following results for the distributions of unit and 10-fold 
sample mean scores, when the binomial definitive of a universe of 17 score classes is ($ + 4)". 


Sample size В, Ps Bs Bs 
1 0 2:875 0 132 
10 0 2.988 0 14:813 


For a universe of 101 score classes specified by successive terms of the binomial (4% + 415)!^, 
we obtain 


B [^ Bs В, 
1 0-07 305 071 16-469 
10 0-007 3:005 0-071 15:148 


It is evident from these results that the distribution of the mean of a sample as small as 10 
closely conforms to the normal pattern for a discrete distribution as flat as may be, and for a 
relatively steep and skew unimodal distribution. It is also noteworthy that the range of the unit 
sampling distribution consistent with this assertion may be very restricted. From that viewpoint, 
the following situation is instructive. 


(d) The “ Burette” Universe 


The term “burette” universe here signifies one of a type of situations which not 
uncommonly arise in the laboratory, when repeated estimations ring the changes on only 3 
consecutive scale divisions consonant with competent workmanship. "We thus suppose that the 
unit sampling distribution involves only 3 score values, which we may label — 1, 0 and + 1, 
if the scores run consecutively. We shall first suppose that we obtain the central score twice as 
often as otherwise so that the specification of the symmetrical unit sample distribution is 


Score З Р, s —1 0 +1 


Frequency . $ . “$ $ t 


Evidently all Pearson coefficients of odd order have zero value. As an exercise the reader may 
check the following : 


бз =3; mBi—9; whe = 27. 
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3-FOLD SAMPLE DISTRIBUTION FROM A SYMMETRICAL BURETTE UNIVERSE 


n ш ДЇ 


АБ: P, Pa P3 Pa Р; P Р 2 Р, ы B Ps RP, 
пй їй йош Em SS RE 
Pa- (P+ Pat Pa) = HS pee BB 
P Po Pa Ю Ps RS P; ‘= P, Po Pa h Ps Pe Р, 
д #% Fits НА BE Bt ДЬ &ee88 SE 
P, 7 (P, P, * P) = Gao P7 (po Pm - m 
P, Po Р; Ю Ps 06: Py & c Py Ро Pa Ра Ps Pe P7 
LI E CERE OE E Ж LE o SD 
Py 7 (P+ Patpa) =- 26 DL ERE 


P, Ро Ру Pa Ps P P; m P, Po Pa h Ps Ps Pr 
э + +5 + ъ Бъ ж ът а в 
һ-(рү+Р›+Р) = - 3p 9,7 (рр, +P) =- 23 


Fic. 107. 2-Fold Sample Distributions from Symmetrical Burette Universes. 
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2-FOLD SAMPLE DISTRIBUTION FROM A SYMMETRICAL BURETTE UNIVERSE 


P, P2 Ps Pa Ps 
aaaba 
Ps- 2,02)" & 


Pi Pa Pa he Ps 
EEEE, 


P520, pg 2 O 


E 


Pi Pa Pa Pa Ps 
$8555 


P3-(i * P2) a 


2 


Pi Pa Pa Pa Ps 
44343 
Pa (epo = 0 


Pr P2 Pa Pa Ps 


o 155 35:305 305 
Pa- (i P2) * 255 


a 


x Pi P2 Pa RR 
ogi nnd 
[I = dy 

E P, Pa Pa P 
ir агаад 
Pa- (Py *Pa)* таа 

EHE 

FEES Pi Pa Ps Ps 
10201 


Ружа $i P372(p; 0370 


Fic. 108. 3-Fold Sample Distributions from Symmetrical Burette Universes. 
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Whence we obtain for the 10-fold sample, the following remarkable correspondence with the 
normal values : 
ao Bs — 3; aob = 1494; quf, = 10341. 


For the 3-class universe with unit scale we may write the u.s.d. more generally as below : 
Score . с .o—1 0 +1 
Frequency . p. (1— pa — Pe) Pe 
If the distribution is symmetrical (p, = p.) the mean is zero, and 
Mx. = 05 Marye = 2ра- 
Thus odd order Pearson coefficients vanish and 
Bo = (2pa)™; Ba = (2р) 7°; 8: = (2a). 


For symmetrical distributions we thus derive results shown in Table 3 which brings into focus 
the issue dealt with in 14.07 : how nearly must the numerical values of the coefficients correspond 
with those of the normal to guarantee a good normal fit ? 


TABLE 3 
Definiti П | " "n 
озы | Grirb Grid dbi ++ (% + 1's + vs)! 
Trinomial 
|Sample Size 
my | A BR hA e АЈА А Ah А A |a A ГД 
Unit. 125 156 195 | 15 225 $38 | 20 +0 80 3 9-0 27-0 50 250 125-0 
2 249 508 1254 | 2-25 619 18-14 | 25 85 39-5 3 135 7425 40 250 2125 
4 256 924 39-09 | 2-63 993 4607 | 275 104 $42 3 143 95-91 $5 21-25 184-06 
6 2:71 1098 55-76 | 275 11:52 61-61 | 287 1261 752 ЕЈ 14-83 100-75 $33 194 163-43 
10 283 1250 72:71 |285 1285 76-88 | 29 1954 8594 3 1494 103-41 $25 178 142-82 
20 291 1379 87-76 | 293 1390 90-11 | 295 14:26 95-00 3 15-0 104-59 зг 16-45 124-95 
40 296 1435 9610 | 296 1444 98-14 | 298 14:99 9988 3 150 104-90 $08 1574 115.24 


When the distribution is not symmetrical, we may write the moments about zero in the 
following form by means of the substitution р, = hp, : 


Haga = Pe(1)*** + pa(— 1)*** = pu — 1); 
Bare = DL ** + po(— 1/*+% = palh + 1). 


In virtue of the identity of odd zero moments and of even zero moments, the expressions for mean 


moments involve only py = pa(h — 1) and и, = pa(h + 1), thus : 


Ms = ps — pi 

ms = ps — Spy, + 29d = (1 — Зиз + 29) 5 

m, = pa — Api + 6p — Зи} = (1 + Gp) — pi (4 + Зра). 
‘Thus we derive 


(h + DI + 653 — 1)] — palh — 1)44 + 3p3( — 1] 
Pah + 1) — ари — 1h — 1) + pea 0) 


The reader may derive other coefficients as an exercise. 


Bs 
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EXERCISE 14.05 
1. If yy is the Ath zero moment of the unit sample distribution and j:,(r) is that of the r-fold sample 
distribution with replacement, show that 
ijo) = та + 1h 
рабт) = тиз + 31 piua + 1 ; 
pal?) = па + Aras + Зр + Grid + AML. 


2. Use the results of 1 to show that the first four zero moments of the distribution whose definitive 
binomial is (g + p)" are 
m=; иа = тр + 1p; 
ра = 2р + 39р + rp; pa = тр + 7090р? + Grp + Мр. 


3. Find the first eight mean moments of the raw-score distribution whose definitive binomial is 


(9+ 2)". 


4. For the 3-class distribution of scores — 1, 0 and + 1 with frequencies pa, рь and р, give the 
values of £,, B», Ёз and В, for the r-fold sample mean-score distribution. 


5. Tabulate the values of 8,, 8», 8, and £, for the distribution of Exercise 4 when r = 5 andr = 10 
for p, = $ and py = $. 


14.06 Moments oF A DIFFERENCE DISTRIBUTION 


In a preliminary way, we have examined in Chapter 6 of Vol I what moment-fitting curve 
is appropriate to describe the distribution of the difference between 2 independent binomial 
variates. In that context our concern was with only the first two Pearson coefficients. We 
shall now take up the same issue from the more general viewpoint of 11.06. 

Before doing so, it is appropriate to clarify an issue we have not as yet dealt with. When 
our concern is to explore the null hypothesis that 2 samples come from one and the same binary 
universe, two courses are open in accordance with the schema below : 


Sample A Sample B Total 
No. of Successes dig | Xy Xa + хь 
No. of Failures REUS b—x, N-x—5 
Total a b N 


In this set-up, our estimate of the proportion of successes in the putative common universe 
of the null hypothesis is 
Xs + хь 


pec 


The estimated mean numbers of successes for the two samples are therefore 
M,=a.p, and M,=b.p,. 
Accordingly, the estimated mean value of the raw-score difference (x, — хь) = D is 
My = (a — 5р. 
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The estimated variances for samples of large size are 
Ve=a.p(l—p,) and V,=b.p(l — py). 
Accordingly, the estimated variance of the difference (x, — x») = D is 
V, = (a + b)p(1 р) = N p(l — р). 
Whence the square standard raw-score difference is 


(D — a — b. p.) 4(b.x, —a.xy* 
N . p1 — P.) М№х, + %)(N — x, — х,) 


For the corresponding proportionate score difference we may write 


5 


() 


_ Poll — Po) д. pl — po) e. N . pdl — $o) 
a b ab А 
Whence we may write for the square standard proportionate score difference 
EY N(b.x,—2a.2)* 
?  ab(x,--oX)(N — x. — Хх) 
Accordingly, and if a — Kb, we derive 
8 M K+ 
Aria Ak 
The expression on the right is a minimum when K = 1, i.e. when the samples are equal, 
in which case c? = са, Otherwise, СЗ > с. If therefore the distribution of the score difference 
is approximately normal in either case, the proportionate score difference will give the higher 
assessment of odds against the null hypothesis unless a = b. 


Va 
(i) 


О . (i) 


In this context it is not inappropriate to refer to a common misconception. Many statistical text- 
books advocate the so-called Chi-Square test for assessing the credentials of the null hypothesis under 
discussion. The fact is that the assessment of odds w.r.t. the proportionate-score difference as pre- 
scribed above is exactly the same as by the Chi-Square test for 1 d.f., Chi-Square in this context being 
the square standard score. For the performance of the latter test, x being the cell score, we define Chi- 
Square (C) in terms of the cell score x and the observed mean (M,) of its four values xa, (a — xa), 
хь, (b — жь) as 


с =>° wm 


Thus we write 


$ | а(х, xl | [5 bx, + | 


а(х, + х) i b(x, + 2) 
N N 
E Mee 
H Waa ae KN— x, — %) 


N N 
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Qm —am*, Qm —amP, braan (be ау 
aN(x, +. жу) ^ NG, +m) ANN — х„— ху) ONON — — ж) 
Gm Саша 

ү |а, а) ау, 9) 

N(bx, — ахь)? 


= ab(x, + N — x, — х) 


The last expression is identical with (ii) ; and it is obviously immaterial whether we care to consult 
the table of Chi-Square for 1 d.f. in order to assess the significance of the square standard score or that 
of the normal integral to assess that of the standard score itself. Тһе two tests must necessarily give the 
same result; but will not give the same result as the normal test for the raw-score difference. The pro- 
cedure last mentioned will in fact give a more conservative estimate of the odds against the null hypothesis 
unless the size of the 2 samples is the same. 


In Chapter 4 of Vol. I we have seen reason to suppose that the raw-score difference dis- 
tribution tends to normality for small values of 7, and r, more closely than that of the proportionate- 
score difference, which has peculiar features for co-prime samples (Chapter 4, Vol. I). Con- 
sequently, the relative advantage of a test based on the latter procedure is not clear-cut without 
further investigation of the approach of the two distributions to the normal. We may explore 
this by the method of 11.06 without confining our attention to the binomial case. 

We first recall the fact that the difference between a score difference and its mean value 
is the difference between the two score deviations, i.e. 


E(x, — х) = E(x,) — E(x»), 
ws (Sa — хь) — E(x, — x) = [ta — E(x)] — [хь — Е(хь)], 
+. (Xa — хь) — E(x, — x») = X, — Ху. 


We therefore write the kth mean moments of the raw-score and proportionate-score difference 
distributions as below : 


Raw-score difference : 


PADIS es T 
Proportionate-score difference : 
X, X 
my(d) = (2! - л) (у) 


As іп 13.05 we shall write the Ath mean moment of the score-sum distribution of the 
t-fold sample as m,(t), and that of the unit sample distribution as m+ using the results of 14.05 
to express the former in terms of the latter. For the raw-score difference distribution we 
then have 

ma(D) = та) + mb) = (a + bm. ; 
т) = та) — m(b) = (a — тз; 
m,(D) = таа) + бта). ma(b) + т) 
= (a + bm, + 3[a'? + 2ab + Б] 


= (a + bym, + 3(a +6) m2. 
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Assuming in what follows (as in Pes that no moments are infinite, we therefore obtain 


аќ 
BAD) Du TM 3 == 200.0. (ii) 
If S = (а + b), we have shown in 13.05 that 
B(S = pis 335) =3 +B 
B(D) _ (a — b} = Y. 
А а В) BAS) . 0. il 


When the two samples are of equal size, B,(D) is zero, and іп any case 8,(0) < f,(S) if 
8,(S) > 0. In general, therefore 

(a) the value of В, for the distribution of the raw-score difference (a — b) is identical with 
that of the distribution of the raw-score sum (a + b), rapidly approaching the normal 
limiting value (Ё, = 3) as (a + b) becomes larger ; 

(b) the value of £, for the distribution of the raw-score difference is nearer to the normal 
limiting value of zero than that of the distribution of the raw-score sum unless the latter 
distribution is also symmetrical. 

For the proportionate-score difference distribution, we may write in accordance with (v) : 


ma) 


a 


m(b m.m; _ (a+ b)my Dm. 
b? a b. M 

ma) mb m, m, (a -—bm. 
а p т BF ay’ 


ü Là ы «(Б AO 
“а= AO. Sone) a 


m,(d) 


+ 


m(a) 


We thus derive 
— by — by 
Bd) = Fat oft = (Gee: 3 Шау у ысу - 69) 


Bd) = за 3) "EPA ‚> 


To get the above into clearer perspective, we may again write a = Kb on the assumption 
that a is the larger sample, whence K > 1 and 

B(d) _ (K — 1) : 

= * ` * . . (8 

ВӘ К > 
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p{d)—3 K?—K+1 1 


v= aa: K-Dn-g. - . - Gi) 


From (ix) we see that ,(d) must be zero as for the normal distribution if the samples are of 
equal size (a = band K = 1); but itis not otherwise necessarily less than 8,(S). ‘The expression 
on the right of (xi) exceeds unity when К 226. This means that the proportionate-score 
difference distribution w.r.t. a-fold and 6-fold samples will be less skew than the score-sum 
distribution of the (a + b)-fold sample, if the ratio of the two samples does not appreciably 
exceed 26. Otherwise, it is more skew. The expression on the right of (xii) always exceeds 
unity, if K > 1, so that the divergence of £,(d) from the normal value will always be greater 
than that of B,(S) and hence greater than that of (D). By comparison of (ix) and (vi) we see 
that 


Bd) (K+ 1) M 
Rmo xc t 4 


Unless K = 1 (when both distributions are symmetrical), this means that the proportionate- 
score difference distribution is more skew than that of the raw-score. It is evident that B, and 
В» for both distributions rapidly approach the normal values of 0 and З as 6, the size of the 
smaller sample, becomes large. For we may write them in the form : 


_ (K—1* poate Ae Р 
B0) — e yb ‚В, and Bd) = 1) 58 
В. — (КаК) 
BAD) а е 1-5 and Ald) —3 = "RT Ot ). 


We may investigate higber Pearson coefficients of the two difference distributions in the 
same way, and obtain 


(a — B, ie. ESOR T 
BX(D) = (a py 5 B.(D) = (a ors) - 5. o fuii) 
E z 
B,(D) = BAS) – c ph) upon e laeso) 
BAD) = RS) — 7 ш Савор e m с...) 
+ b) 


Thus B,(D) = B,(S) and BD) = (5) if the unit sample distribution is symmetrical. We 
also see that the values of Ё, and £; for the raw-score difference distribution will always be less 
than those of the corresponding coefficients of the score-sum distribution unless the unit sample 
distribution is symmetrical, in which case all coefficients of odd order vanish in both cases. 
If the unit sample distribution is skew and leptokurtic the values of В, and f; for the raw-score 
distribution will be smaller than those for that of the score-sum, i.e. the raw-score distribution 
will be less leptokurtic as well as less skew. Our investigation of the moments of the raw-score 
difference distribution thus leads us to the conclusion that it approaches more closely to the 
normal than does the score-sum distribution for the (a + b)-fold sample; but we have already 
seen that no comparable straightforward statement applies to the difference distribution of the 
proportionate score. 
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Expressions for higher Pearson coefficients of the latter are unwieldy and the derivation is 
laborious. Accordingly, we shall cite only approximate expressions, neglecting terms which are 
trivial. When (a + b) is large : 


_ 10(K — 19%, | ~ 105(K — 1)?, | 
Bd) = кок peri В:(а)= KK + 15 Bii 
ag, IE — K +1) 10(K — 1), . 
Bd) = 15 KK EDS (В. 3) + RKF "EH 
Bald) = 105 4 210K(B, —3) , 280(K* + 1) 


(K--1p.b ' K(K+1).8° 


Evidently, all the above approach the normal as limiting values when (and hence also а) 
is large. 


1407 NORMAL APPROXIMATIONS 


How nearly the standardised moments of a discrete distribution approach those of the normal 
is a purely algebraic issue, if the algebraic pattern of the former is specifiable. How close the 
correspondence must be to justify recourse to the normal as a descriptive function is largely an 
empirical one ; but it may be possible to limit the ground for numerical exploration by reference 
to an alternative standard. Many theoretical distributions whose moments are specifiable 
(e.g. the Poisson) closely approach the normal with suitable choice of parameters ; and if they 
are amenable to tabulation it is a simple matter to choose one as a yardstick distribution. For 
instance, we may easily derive from the tables of the Poisson function what value of its single 
parameter M ensures a percentage error no greater than e for summation of all values up to the 
2e level. We may then ask what conditions ensure that the standardised moments of the 
binomial variate defined by successive terms of (q + р)" lie closer to the normal than do those of 
the Poisson yardstick distribution. 

When we speak of a binomial variate so defined in the most general sense, i.e. without 
restriction on the origin or scale, we assume a set of scores of range a to a + rAx so that fa) . ?*g'-* 
is the frequency of the score a + xAx. If we are speaking of the raw-score of an r-fold sample 
from an infinite 2-class universe this means that а = 0 and Ax = 1. If we are speaking of the 
proportionate-score deviation of such a sample a= —p and Ax—:7!, If we are speaking of the 
mean score of the 3-fold toss of a tetrahedral die with face pips 2, 4, 4, 6 we have a — 2 and 
Ax = $. Here it suffices to consider the situation which arises when a = 0 and Ax = 1 since 
4 does not affect the value of the mean moments and the appropriate power of Ax appears as a 
scalar factor common to both the numerator and the denominator of the Pearson coefficients. 
Since also (q + p)" defines the sampling distribution of the ra-fold score-sum from an infinite 
two class universe and that of the r-fold score-sum from a universe of (a + 1) classes whose 
frequencies tally with successive terms of (g + р)®, it will suffice to define the moments of any 
binomial universe in terms of those of the universe of 2 classes. 

With that end in view it will be convenient to write q = mp, so that p = (m + 1)-1, and if 
rp = M, r = M(m + 1). 1f q+ defines the u.s.d. of score values 0, 1 and deviations — р, 
q = (1 — р), we may write: 

тта —1). 


mea = — p) + ptt = pt — 9") = o 


128—1. 1 
ma = 0—09 + pa = patri + pe TOL. 
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Whence 
(m — 1». mml. 
В, ms Bs 5 ; 
(m — 1m? + 1). m*—m--m-—m-cl, 
Bs Ex] PB m? , 
(m — 1)%(m‘ + m? +1) , mê — т5 + т^ — m +m —m +1 
В, L 27 = 


From the above we see that odd Pearson coefficients vanish only if m = 1 (p = 4 = 4) 

as we know ; and we can define the value of m which confers normal kurtosis by putting 
2—m+1 
в,=З= tr so that m? — 4m +1 = 0. 

The roots of the above are approximately 3:73 and 0-27 corresponding to р 220-21 and 0:79 
within which range 8, <3 and the distribution is platykurtic. Outside this range the distri- 
bution is leptokurtic and skew as is true of the Poisson. For the distribution defined by successive 
terms of (9 + p) in terms of m and М = 7р we have the following values of the Pearson 
coefficients tending to the Poisson limits and lying consistently between those of the Poisson 
distribution and those of the normal outside the range m > 3-73: 


_ m- 201. 2 9 
8; = Эбби) M in the limit ; 
1 5m —1 ne LEE 

В. = 34 M Mmm)? tM in the limit ; 

(т — 1)? — 10т +1) , lm— 1)? 1 10. ЕМА 
e uer К dI ww curie 
Apert 25(m2—m +1) , (m*—m+1)*  24(m*—m x1) - 55 
a © "Mm(m -1) — M*m(mc1ly — M*m(m +1) Мт +1) 

р 
2 15 4 du : in the limit. 


+мңт+їй М м 


Expressions for Pearson coefficients of higher orders may be obtained in a similar form, 
but are very unwieldy. We here cite the Poisson limiting forms : 


105 56 1 


Ee ADOT НӘ" жи1, 
ee a + ae M Be = 105 + ap + 


me + М 


The above relations presuppose т > 1, so that q > р as is true of the Poisson distribution. 
Now the histogram of the distribution whose definitive binomial is (д + p)" is the mirror image 
of that of the distribution whose definitive binomial is (p + q)". · For every value m = k in the 
range m > 3-73, there will thus be in the range m < 0-27 a value m = k-! definitive of a distri- 
bution with identical Pearson coefficients. "The above relations thus hold good for the range 
m < 0-27 if we reverse the score order, i.e. we put M — rg when g <p. For a given value 
of M = rp when p <q (or M = rq when q <p), we may therefore say that the variate 
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whose definitive binomial is (g+ p) has mean moments nearer to their normal values 
than those of the Poisson distribution with the same parameter M if p lies outside the 
range stated, Subject to this restriction we may therefore say that the normal is a satisfactory 
fitting curve for a binomial variate if M exceeds the value for which the Poisson distribution 
tallies as closely with the normal as a satisfactory fit implies in the context. Table 4 shows how 
closely the Poisson distribution does in fact correspond to that of the normal at prescribed sig- 
nificance levels for three different values of M. Tables 5 and 6 explore the intermediate zone 
of p values consistent with platykurtosis of a binomial variate. "Table 7 shows values of the 
Pearson coefficients for binomial variates with assigned values of M. In Tables 4-6, as in other 
tables of this chapter, the column headed exact under frequency refers to that of the discrete 
distribution, and the column marked normal next to it cites the corresponding ordinate of the 
normal curve. Under cumulative frequency, the column headed normal refers to areas bounded 
by the corresponding ordinate on either side of the mean after making the appropriate half interval 
correction. 


TABLE 4 
Comparison of Cumulative Frequencies of Normal and Poisson (М = а) Distributions 


M =6; B, = 0-16; В,=3-16. |M = 10; В, = 0-10; B, = 3-10.| М=15; B,=0-06; ,—3:00. 


Raw-Score 
Deviation | [ | 
x a | 
х p Poisson | Normal E Poisson | Normal X | Poisson | Normal 
—12 | 0-0002 | 0-0015 
=H | | 0-0008 0-0034 
—10 0-0027 0-0068 
-9 0-0075 0-0141 


0-0179 | 0-0264 
0-0373 | 0-0467 
0-0697 | 0-0778 
01183 | 0-1227 
0-1846 | 0-1831 
0:2146 |—0-7746 | 0:2675 | 0-2593 
0:3176 |—0-5164 0-3631 0-3493 
0-4382 |—0-2582 | 0-4655 | 0-4486 
0-5618 0:0000 | 0:5679 , 0:5514 
0-6824 0-2582 | 0-6639 | 0-6507 
0:7854 0-5164 | 07486 | 0:7487 
0-8658 0-7746 0:8192 0-8169 
0-9226 1:0328 | 0:8749 | 0:8773 
0-9590 1-2910 | 0:9167 | 0-9222 
0-9801 1:5492 | 0-9466 | 0-9533 
0-9911 1:8074 0-9670 | 0-9736 
0:9964 2-0656 | 0-9803 | 0-9859 
0-9987 2:3238 | 0-9886 | 0-9932 


8 

6 —2-4495 | 0:0025 | 0:0124 
5 —2:0412 | 0-0174 | 00310 
4 —1-6630 | 0:0620 | 0-0765 
3 —1-2247 | 0-1512 | 0-1537 
2 —0-8167 | 02851 | 0-2702 
1 —0-4082 | 0:4457 | 0:4191 
0 0-0000 | 0-6063 | 0-5809 
1 

2 

3 

4 

5 

6 

7 

8 

9 


0-4082 | 0:7440 | 0-7298 
0:8165 | 0-8473 | 0-8463 
1:2247 | 0-9161 | 0-9235 
16630 | 0-9574 | 0-9690 
2.0412 | 0-9799 | 0-9876 
2.4495 | 0-9912 | 0-9960 
2:8577 0-9964 0-9989 
3-2660 | 0-9986 | 0-9997 
3:6743 | 0-9995 | 0-9999 


10 4:0824 0-9996 2-5820 0:9936 0-9966 
11 4-4906 0-9998 2:8402 0-9965 0-9985 
12 T 3-0984 0:9981 0-9994 
13 3-3566 0:9990 0:9997 


14 3-6168 0-9994 0-9999 
15 3-8730 0-9996 m 
16 41312 0-9997 
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TABLE 5 


Ф 09; M=10; c = 22361; В, 20; В, = 290 


Raw-Score Frequency Comiulative 
Deviation z z Frequency 
X М 
Binomial Normal Binomial Normal 
0 0 0:1762 0-1784 0-1762 0:1770 
+1 + 04472 0-1602 0-1614 0-4966 0-4977 
42 + 0:8944 0-1201 0-1194 0-7368 0:7344 
+3 + 13416 0-0739 0:0725 0-8846 0:8824 
+4 + 1-7888 0-0370 0-0361 0-9586 0-9558 
+5 + 2-2360 0-0148 0-0151 0-9882 0-9861 
+6 + 26832 0-0046 0-0049 0-9974 0:9963 
+7 + 3-1304 0-0011 0-0013 0-9996 0-9992 
+8 + 3-5776 0-0002 0-0003 1-0000 0-9999 
L 
TABLE 6 
(8+); M = 10; о = 27386; B, = 0-03 ; B, = 2-983. 
Raw-Score Frequency Cumulative 24 
Deviation x ies Frequency 
ES s 
Binomial Normal Binomial Normal 
— 10 — 36510 0-0000 0-0002 0:0000 0-0003 
9 — 3:2864 0-0001 0-0007 0-0001 0-0010 
=$ — 2.9212 0-0009 0-0021 0.0010 0-0021 
= 7 — 2-5561 0-0037 0-0056 0-0047 0-0089 
= 6 — 2.1909 0-0113 0-0133 0:0160 0-0223 
= 8 — 1-8258 0-0273 0-0277 0-0433 0-0502 
>з — 14606 0-0530 0-0499 0-0963 0-1006 
F] — 1-0955 0-0857 0-0799 0-1820 0-1806 
-2 — 0:7303 0-1179 0-1116 0:2999 0-2919 
Ed — 0-3651 0-1398 0-1363 0-4397 0-4275 
0 0-0000 0-1444 0-1457 0-5841 0:5725 
1 0-3657 0-1313 0-1363 0-7154 0:7081 
2 0:7303 0-1057 0-1116 0-8211 0:8194 
3 1-0955 0-0759 0:0799 0-8970 0-8994 
4 1:4606 0-0488 0-0499 0-9458 0-9498 
5 1-8258 0-0282 0:0277 0-9740 0-9777 
6 2.1909 0-0146 0-0133 0-9886 0-9911 
7 2-5561 0-0069 0-0056 0-9955 0-9969 
8 2.9212 0-0029 0-0021 0-9984 0-9990 
9 3-2864 0-0011 0-0007 0.9995 0-9997 
10 3-6510 0-0004 0-0002 0-9999 0-9999 


4* 


619 


620 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


TABLE 7 


Higher Pearson Coefficients w.r.t. distributions defined by (Ф + $)", (8 + $)”, ($ + 2)" and (3% + dig). 


"= 12 20 30 

t= + + + ys i + i ye + + i vs 
В. [] ооз 011 0-59 о 0-03 0-06 036 | 0 0-02 oor | оз 
Вз 283 287 2-04 348 2:90 292 297 326 293 2-96 9-98 317 
Bs 0 0-39 1:05 588 о 0-24 0-64 $54 0 016 043 2:36 
Bs 1261 | 1320 | 1520 | 2589 | 1354 | 1390 1499 | 2216 | 1402 1426 | 1489 | 2040 
Bs 0 $68 | 1021 57-59 [] 297 647 | 3504 0 1-63 440 | 23-09 
Be 79-98 | 9056 | 11918 | 31037 | 8545 | 9631 | 114-73 | 258-27 | 91-65 9920 | 111-90 | 204-96 


If we take the Poisson distribution for M — 10 as our yardstick of satisfactory fit, we may 
thus say that the following range of values for the Pearson coefficients of a leptokurtic binomial 
variate are consistent with a good fit in the same sense : 


В <01 ; В < 31; B,—11; 
В, < 17:5; В < 11:0; B, < 155. 


For symmetrical leptokurtic distributions, the tabulated t-variate (Type VII) dealt with in 15.04 
below, provides us with a standard of comparison, and we may generate symmetrical platykurtic 
yardstick distributions by sampling from the rectangular universe. "Table 8 exhibits the close 
correspondence between the normal distribution and that of the total score of the 6-fold toss 
of a tetrahedral die with face-scores 1, 2, 3, 4. For this distribution В, = 2:773. 

"The sample distribution of Table 8 is referable to score totals increasing by unit steps from 
6 to 24, being therefore a distribution with 19 score classes like the symmetrical binomial variate 
defined by successive terms of ( + 4). For the latter distribution M = 9 and £, = 2-89; 
and we may expect a very satisfactory normal fit for a symmetrical platykurtic distribution of 
20 or more score classes if Ё, >28. Needless to say, fitting a continuous curve to a discrete 
distribution is an unduly hopeful undertaking if the number of score classes is fewer. 

With due regard to the caveat last stated, the rapidity with which themean scoreof thesample 
approaches normelity is remarkable when the distribution is not very skew. Table9 is instructive 
from this viewpoint. It describes the distribution of 14-fold samples from a U-shaped burette 
(3-class) universe, i.e. a sample distribution of 43 score classes. The normal estimate of 
odds against a value numerically as great as or greater than 2.10 is 39:1 as against 38:1 
assigned by the exact distribution. For comparison Tables 10 and 11 give respectively the 
10-fold sample mean-score distributions from a skew and slightly platykurtic 3-class universe 
and the 8-fold sample mean-score distribution from a skew and slightly leptokurtic 3-class 
universe. 

In 14.06 we have seen that the raw score and proportionate score difference distributions 
of equal (a-fold) samples from an infinite 2-class universe are identical and that their moments 
must lie nearer to the normal than do those of the distribution of the 2a-fold sample score sum 
or mean score except when m = 1 (p = $ = q), in which case the three distributions are identical. 
The accompanying Table 12 exhibits how close is the normal fit for more or less skew binomial 
difference distributions, each being referable to the difference between the scores of samples 
of 10 from a 2-class universe for p = 0:5, 0-25, 0-20 and 0-10. 
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TABLE 8 


Comparison between the Normal Integral and a 6-fold toss of a Tetrahedral Die. 


c,—2339 В, = 2-773 
Score-Sum Frequen Cumulative 
Devistion 2:5 aa Ferias 
X os 
Exact Normal Exact Normal 
0 0-0000 0-1416 0-1457 0-1416 0-1449 
1 0:3651 0:1333 0:1363 0-4082 0-4161 
2 0-7302 0-1113 0-1116 0-6308 0-6386 
3 1-0953 0-0820 0-0799 0-7948 0-7987 
4 1-4604 0-0527 0-0501 0-9002 0:8996 
5 1:8255 0-0293 0:0275 0-9588 0:9555 
6 2-1906 0-0137 0:0137 0-9862 0-9824 
7 2:5557 0-0051 0-0056 0-9964 0:9938 
8 2-9208 0-0015 0:0020 0:9994 0-9981 
9 3-2859 0-0003 0:0007 1-0000 0-9995 
TABLE 9 


Comparison between the Normal Integral and the burette sampling distribution specified by (6 + $ + $)“ 


о = 3:347 (By = 2:875 
Score-Sum Xx Frequency сы» 
Deviation т 'гедцепсу 
es Exact Normal Exact Normal 
0 0-0000 0-1173 0-1192 0-1173 0-1180 
1 0-2988 0-1124 0-1140 0-3421 0-3460 
2 0:5975 0.0992 0-0997 0-5405 0:5449 
3 0-8963 0-0801 0:0798 0:7007 0-7043 
4 1-1951 0-0589 0:0584 0:8185 0-8212 
5 1-4939 0:0410 0:0391 0-9005 0-8996 
6 1-7926 0:0247 0:0239 0:9499 0-9478 
Я 2-0914 0-0137 0-0134 0-9773 0-9750 
8 2-3902 0:0068 0.0068 0:9909 0-9889 
9 2-6889 0-0030 0:0032 0-9969 0:9954 
10 2-9877 0-0011 0-0014 0:9991 0:9983 
11 3-2865 0-0004 0-0005 0-9999 0:9994 
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TABLE 10 
Comparison between the Normal Integral and the burette sampling distribution specified by (à + $ + $)". 
o=2357 8-290 
= 
Cumulative 
ШЫП z Pe m 

25 Exact Normal Exact Normal 
mm — 43841 0-00002 0-00001 0-00002 0-00001 
— af — 3-9598 0-00013 0-00007 0-00018 0-00009 
-4 — 3-5356 0-00057 0-00033 0-00072 0-00044 
-4 — 3-1113 0-00203 0-00134 0-00275 0-00187 
Е — 2.6870 000601 0-00458 0-00876 0-00667 
33 — 2-2628 0-01514 0-01309 0-02390 0-02018 
> — 18385 0-03275 0-03123 0-085665 0-05195 
ES — 14142 0-06106 0-06227 0-11771 0-11466 
=з — 0-9900 0-09826 0-10368 0-21597 0-21834 
es — 0:5657 0-13628 0-14422 0-35225 0-36182 
={ — 01414 0-16214 0-16757 0-51439 0-52820 
HER + 0-2828 0-16413 0-162682 0-67852 0-68969 
+4 + 0:7071 0-13947 0 13442 0-81799 0-82102 
nn + 11314 0-09748 0-08924 0-91547 0:91044 
LM + 1-5556 0-05425 0-05047 0-96972 0:96144 
nm + 1.9799 0-02279 0-02384 0-99251 0-98581 
n +24042 0-00651 0-00941 0-99902 0-99555 

+2 + 2.8284 0-00098 0-00310 1.00000 = | 

TABLE П 


Comparison between the Normal Integral and the burette sampling distribution specified by (y + y + др) *. 


о = 1:523 (В, = 3-04 


= 
© 


— 44649 
— 3-8083 
— 3-1517 
— 2-4951 
— 1-8385 
— 1-1819 
— 0-5253 
+ 0-1313 
+ 0:7879 
+ 154445 
+ 23011 
T 27577 
+ 3:4143 
+ 40709 


Cumulative 
Frequency E cy. 

Exact Normal Exact Normal 
0-00001 0-00001 0-00001 0-00002 
0-00020 0-00019 0-00021 0-00025 
0-00185 0-00183 0-00206 0-00238 
0-01138 0-01165 0-01344 0-01513 
0-04721 0-04834 0-06065 0-06551 
0-13019 10:13003 10:19084 0-19667 
0-23196 0-22817 0-42280 0-42192 
0-26039 0-25969 0-68319 0-67712 
0-18886 0-19204 0-87205 0-86783 
0-09104 0-09228 0-96309 0-96186 
0-02954 0-02881 0-99263 0-99243 
0-00640 0-00585 0-99903 0-99898 
0-00089 0-00077 0-99992 0-99991 
0-00007 0-00007 0-99999 0-99999 
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TABLE 12 
Distributions of Raw-Score or Proportionate (Mean) Score Difference for equal 10-fold samples from more or 
less skew 2-class universes, the assumption being that (a) the universe is infinite, or (b) the universe is finite and 
sampling is subject to the replacement condition. 


p-i-a 
Cumulative 
Raw-Score D Fi ient 
Difference = saan Еа 
e Exact Normal Exact Normal 
0 0-0000 0-1762 0-1784 0-1762 0-1770 
1 0-4472 0-1602 0-1614 0-4966 0:4977 
2 0-8944 0-1201 0-1194 0-7368 0:7344 
3 13416 0:0739 0:0725 0-8846 0:8824 
4 1-7889 0-0370 0-0361 0-9586 0:9558 
5 2.2361 00148 0-0151 0-9882 0-9861 
6 2.6833 0-0046 0-0049 0-9974 0:9963 
7 3-1305 0:0011 0:0013 0-9996 0-9992 
8 3:5777 0-0002 0-0003 1-0000 09999 
p-iia-i 
0 0-0000 0:2056 0:2060 0-2056 0:2038 
1 0:5164 0-1800 0-1801 0:5658 0-5614 
2 1-0328 0-1212 0-1208 0-8080 0:8033 
3 1-5492 0-0625 0:0623 0:9330 0-9293 
4 2.0656 0-0247 0-0246 0-9824 0:9799 
5 2.5820 0-0073 0-0074 0-9970 0-9955 
6 3:0984 0:0016 0:0017 1-0000 0-9992 
7 3.6148 0-0003 0-0003 1-0000 0-9999 
p-tia-k 
0 0-0000 0:2238 0:2230 | 0-2238 0:2202 
1 0-5590 0-1909 0-1907 0.6056 0-5982 
2 1-1180 0-1190 0-1194 0-8436 0:8377 
3 1-6770 0:0544 0:0546 0-9524 0:9496 
4 2.2360 0-0184 0-0183 0-9892 0-9881 
5 2-7950 0-0046 0:0045 0-9984 0:9979 
6 3-3540 0:0008 0-0008 1-0000 0-9997 
7 3:9130 0-0001 0-0001 1-0000 
p= a= 

0 0-0000 0-3126 0:2974 0:3126 0:2907 
1 0:7454 0-2219 0-2252 0:7564 0:7395 
2 1-4907 0-0920 0:0979 0-9404 0:9376 
3 2-2361 0-0246 0-0244 0-9896 0:9909 
4 2-9814 0:0045 0-0034 0:9986 0-9992 
5 3-7268 0:0006 0:0004 0-9998 1-0000 
6 4-4721 0-0001 0:0000 1-0000 


Tables 13 and 14 exhibit score difference distributions for samples of equal size from 
burette (3-class) universes. 
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TABLE 13 


Comparison between the Normal Integral and the Mean-Score Difference Distribution of 6-fold samples 
drawn from a Burette Universe in which p, = 0-3, h = 2. 


о = 0°5196 B.(d) = 2:877. 
‘Smee | 4 inn: em 
Deviation E 
Exact Normal Exact Normal 
0 0-0000 0-13393 0-12796 0-13393 012746 
+ 0-3208 011254 0-12154 0-35901 0-36959 
1 0-6415 0-11045 0-10415 0-57991 0:57738 
3 0-9623 0-07570 0-08053 0:73131 073840 
1 1-2830 0-06146 0-05624 0-85423 0-85107 
Li 1:6040 0-03360 0-03537 0-92143 0-92228 
4 1:9246 0-02250 0-02008 0:96643 0-96293 
t 2.2453 0-00939 0-01029 0-98521 -98589 
+ 2-5661 0-00513 0-00475 0-99546 099358 
i 2-8868 0-00149 0-00198 0-99846 0-99768 
ap 3-2076 0-00065 0-00075 0-99976 0-99923 
Y 3-5288 0-00010 0-00025 0-99996 0-99977 
ae 3-8492 0-00003 0-00008 1-00000 0-99994 
TABLE 14 


Comparison between the Normal Integral and the Mean-Score Difference Distribution of A-fold samples 


drawn from a Burette Universe in which p, = 0-1, h = 2. 


о = 0-3808 B,(d) = 3-038 
Mean-Score 4 E Cumulative 
Difference = н. Frequency 
Deviation Bi 
d Exact Normal Exact Normal 
0 0-0000 0-26427 0-26191 0-26427 0-25732 
i 0-6565 0-21105 021111 0-68637 0-67526 
1 1-3130 0-10933 0-11071 0-90503 0-89928 
2 1:9695 0-03749 0-03766 0-98001 0-97844 
+ 2-6260 0-00857 0-00833 0-99715 0-99686 
5 3-2825 0-00129 0-00120 0-99973 0-99969 
EH 3-9391 0-00012 0-00011 0-99997 0-99998 
i 4-5956 0-00001 0-00001 0-99999 0-99999 


It is very important to recognise the implications of the half interval correction when assessing 
the odds in favour of or against a score value equal to or greater than a standard score of unit 
variance definitive of a sample from a discrete universe. The variance of the distribution whose 
definitive binomial is (} + 4)" is rpg = 4, so thate = 2. Thus the standard score corresponding 
to a raw score deviation of + 4 (x = 12) is 2. With due regard to the half interval, the corre- 
sponding entry in the normal table is (4 + 3) +2 = 2-25. The vector probability that a normal 
score of unit variance will not exceed + 2:25 is about 0-9875 or odds of over 70:1 against. 
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The vector probability that a normal score of unit variance will not exceed + 2-0 is 0-9773 or 
odds of 43 : 1 against. 

The exact probability of a score as great as 46 in the 10-fold toss of an ordinary cubical 
die is 0-9843 (to 4 significant figures). The s.d. of the 10-fold toss distribution is 5-401 about 
a mean of 35, so that the corresponding standard score is (46 — 35) + 5:401 ~ 2-037. With 
the half interval correction the corresponding entry in the table of the normal integral will be 

1 
2.037 + 266401) ^ 213. 
For this value the normal integral gives approximately 0-9834 an error of about 1 in 1000. This 
makes the odds (vector) against the occurrence : 


Exact . à . . . : D Е 3 : 2296327] 
Normal approximation with half interval correction . t a 50:1 
Normal approximation without half interval correction . rae ан 


The reader may find it worth while to calculate the corresponding modular odds. 


14.08 SAMPLING FROM DIFFERENT UNIVERSES 


By recourse to the product rule we can infer the distribution of the score-sum or mean score of 
p independent samples each taken from a different, as well as of p such samples taken from the 
same, universe. If G,(a), G,(b), etc. are the generating functions of the u.s.d. of universe A, 
universe B, etc. respectively, and G,(s) is that of the p-fold score-sum, 


Су) = G.(a) . Gu(b) . Gule) ... ete. . : e sa) 
If all the universes from which we take each unit sample are identical, as is necessarily so if we 


take them (with replacement) from one and the same universe, we may write G,(a) = Gu = Gb), 
etc. and 


Суз) = GE. к А Я s = 3 nm 
The following example illustrates the meaning of (i) : 
Universe A Universe В 
Soe| 3 4 5 6|—8 & X X * 


| 
| 
Frequency Ye ote te we | tee fete ae 


To exhibit the product rule we may lay out our grid for the score-sum of unit samples from 
each universe as follows : 


Cell Scores (x 3) Cell Frequencies (x 16°) 
3 4 5 6 4 4 4 4 
—i 8 11 14 17 1 4 4 4 4 
$ 14 17 20 23 4 16 16 16 16 
ap 20 23 26 29 6 24 24 24 24 
az 26 29 32 35 4 16 16 16 16 
E 32 35 38 4l 1 4 4 4 4 
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The score-sum distribution is thus : 


Sore . { MB AB aR Y за за зз зд ap за ag 
Рату. de ods k k М OR MR MR эй A ан X 
For the generating functions we may write 
Gula) = (е + e + e^ + e; 
at Ба и» MK s 
С) = 3lg(e ? + 4e? +6e? + 4e? +e’). 
By direct multiplication we obtain 
8h B MA 17A 205 23A 
Gula) . G,(b) = dle? -- e? -- 5e? -- 5e? + 10e? -- 10e? ... etc.) 


Each coefficient in the above corresponds to one of the frequency terms of the sum distribution, 
and the co-fa: tor of Й in the exponent of e is the corresponding score-sum itself on the assumption 
that we take 2 unit samples one from each universe. It is very important to recognise that this 
is not the same thing as taking a 2-fold sample from the equivalent homogeneous (Bernoullian) 
universe. Since our sample prescription is that we take equal (unit) samples from each stratum 
we can conceptualise a corresponding destratified universe on the assumptions : (a) that the two 
strata each contain the same number (16) of items and the common pool contains 32 in all ; 
(b) that we replace each item before drawing another. The u.s.d. of this pooled universe is then 


Score. .—À1 $ 3 E 4 5 ag 6 ag 
Frequency . ds ods м v ode з ove te de 
For such a Bernoullian universe we may write 


E a a us z a K mi St 
E E E uS E UT. +, . EE ng) 
The generating function of the 2-fold sample from the same universe is Gz, from which we 
derive by direct multiplication the following score-sum distribution as the reader may check 
by recourse to the grid : 


Score Frequency Score Frequency 
(x 3) (х 1024) (x 3) (x 1024) 


555852598529g5u5 
--o»2555552222 


5 
585388559508 оо 


The foregoing example shows that : (а) the score-sum distribution w.r.t. unit samples from 
each of p strata of a stratified universe is very different from that of p successive samples from 
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the equivalent unstratified universe ; (b) the specification of the equivalent Bernoullian universe 
admits of no simple recipe in so far as difference of origin as well as scale w.r.t. the unit sample 
distribution of the strata determine its character. It is, however, possible to probe the issue 
further, if we make the assumption that each stratum u.s.d. has zero mean. 

To bring this assumption to life, we may suppose that each universe of the foregoing example 
is a lottery wheel like that of Fig. 97 assigned to one of two players and then consider the result 
of recording the score of a 2-fold spin of each. At each trial we thus record two scores, 4, а, 
w.r.t. lottery wheel A and 5, Б, w.r.t. lottery wheel В. Instead of allocating to the player the 
score-sum, we may record the result as the paired difference scores of each of them, vis. : 
d, = a, — a, and dy — b, — b, In 14.02 we have seen that the distribution of both sets 
of paired d-scores must be symmetrical about zero meam ; and we may write their generating 
function as follows : 


G(d,) = Hl + ef + £^ + ehem 


ж n m I зму 
G(d») sis ar + 60 рае фе?) (2 


"The above reduce to а more convenient form for purposes of differentiation : 


e ur e 4 e“); 


+ 4e 


E -2 А 32 
G(d,) = zele Pte ®+ ё+ 2) 5 (iii) 
Gid) —-2e^-- ep . : 2 è E ; . (iv) 
Thus our new distributions are as below : 
Frequencies 
Scores 
di d, Total 
-8 1 0 1 
– 6 8 0 8 
—4 28 0 28 
L8 07 * 4 16 16 
-2 56 32 88 
=l 0 48 48 
0 70 64 134 
1 0 48 48 
2 56 32 88 
3 0 16 16 
4 28 0° 28 
6 8 0 8 
8 1 0 1 
"Total 256 256 512 


The results of recording pair difference scores from the two lottery wheels with border- 
scores as specified at the beginning of this section would, of course, be the same as those of 
recording the single score distribution of lottery wheels with score distributions respectively 
identical with those of d, and d, above. We then have again a universe of 2 strata but this time 
the means of the two distributions are identical, both being zero. On the assumption that we 
take samples of equal size from each stratum, the equivalent homogeneous universe is as specified 
by equal weighting in the column marked “Total”. In this composite distribution each frequency 
term is the sum of the corresponding terms of the stratum distributions divisible by twice the 
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common total, i.e. each frequency is the mean of the corresponding frequencies of the two d-score 
distributions. "Thus we can express the m.g.f. of the composite homogeneous universe by the 
relation 

Go) = MG(4.) + G(4)]. 


We can extend this result by iteration to any number of strata on the same assumption, viz. that 
the stratum distributions all have zero mean. For f strata we have 


1%% 
С. = S ca) Е Я - S 4 . (у) 
b 2=1 
It follows from (v) that the moments of the u.s.d. of the Bernoullian universe will be the mean 
of the corresponding stratum moments. If we take one sample from each stratum the m.g.f. 

of the distribution of the p-fold score-sum is as given by (i), viz. : 


ECG) SG Cn s^ os 3-05) 


z-1 


If we take p independent unit samples from the composite homogeneous universe, the m.g.f. 


of the score-sum distribution is 
1'e м A 
С? = G 57 Gd.) E Я А 2 . (vii) 


z-1 


If the stratum distributions are normal, (vi) becomes 


G(s) = ТЇ ave, 


z-1 
If V = (V, + Vy + V. . . .) this is equivalent to 
С) = ата: a ü : 3 М - (viii) 


"The last expression defines the m.g.f. of a normal distribution of variance V. Subject to the 


same assumption (vii) becomes 
z- » 
Toae 


2-1 


The last expression evidently cannot reduce to the same form as (viii) unless V, = V, = V, ... 
etc. in which case 


IS arai ans о - 7 è * 37 1631 


Pia 
This is the m.g.f. of a normal universe of variance V, = V, etc. and that of the p-fold score-sum 
distribution is 
ATH дә» A : E : AEST 


We thus see that the distribution of the sum of p paired difference scores from different 
normal universes is necessarily normal, but it is equivalent to the distribution of the p-fold 
sample score-sum from the homogeneous pooled universe only if one assumption holds good. 
If the sub-universes (strata) from which we extract our score-pairs differ w.r.t. the value of the 
mean only, the distribution of the paired difference having zero mean will be identical from 
stratum to stratum, and taking р samples from any one of them amounts to the same as taking 
one sample from each of the p strata. If so, we can look on each d-score as a unit sample from 
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one and the same normal universe, and since the d-score has zero mean, an unbiased estimate 
of its variance (У „) based on p samples is 


ое oro OB) 


For the variance of the mean score of a p-fold sample from such a universe we have as our 
unbiased estimate 


2 sap 
а T eT 
Р Р: 
The mean d-score itself is 
157 
M=- S d, 
==1 


p Acen ч š Я : . (xiv) 
z-1 Ы 


"The justification for the derivation of (xiv) is that the d-scores constitute a homogeneous normal 
universe whose u.s.d. variance is definable in the usual way. 

We shall now assume that the variances of the d-score distributions are not identical, in 
which case their p-fold score-sum distribution is still normal in accordance with (viii), the 
variance being 

Ү=ў,+Ё,+Ё,+... - . б М . (xv) 
If we denote the score-sum Бу s, we have s = pM, and derive the variance (V „) of the mean score 
deviation by the usual scalar transformation : 
V —pPV.. О : : T E . (xvi) 
To evaluate V in terms of our observations, we note that we have one sample score d, from which 
to estimate У„ one sample score d, from which to estimate V, and so on. If we did not know 
that the true mean of each of the d-score distributions is zero, we could not do this; but our 
assumption is that we do have this knowledge. То appreciate the implications of this let us 
make explicit the distinction between the true mean (Mu) and the sample mean (M,) of an r-fold 
sample of scores (x), employing the symbol E,(. . .) to signify the operation of extracting the mean 
of the complete sampling distribution. We may then write 


Xc-ay 
Be) = У, if 4-3— 20. a (ui) 
ку = У, ifs Lec (xviii) 


* More fully, if ЕД. . .) is the operation of extracting the sample mean and E, . E, = E= E, . E, 
V, = E(x — M, = Е?) if M, —0; 
oi = E(x — M,y! = Ех?) if M, = 0. 
Whence if M, — 0 
Едо) = E, . E(*) = Ех?) = Vu. 
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In (xviii) M, = x if we have only one sample value of x and (x, — М,) —0; but if so r = 1 and 
(r — 1) = 0, whence the value of s? is indeterminate. If we know that M, = 0 in (xvii), o2 is an 
unbiased estimate of V,. We may thus write for our distribution of unit sample d-scores from 
different universes 

Е (а= V, БАЙ = У, ес., 

"Еда + а + 0...) = У. 
In accordance with (xvi) our unbiased estimate of V, is therefore 

УЖА 
P 
As before, we may write the square of the mean d-score as 
maa 
p 

Whence we derive the empirical square critical ratio of the mean d-score, i.e. square standard 
mean d-score, in the same form as (xiv), viz. : 


MY P 
tan See 0 7 y D 
‘Thus the rationale of the approximate (large sample) c-test for paired differences does not 


necessitate the assumption that each paired difference is a unit sample from a universe with the same 
variance as each other such universe. 


(xix) 


EXERCISE 14.08 
1. Four players each toss one of 4 tetrahedral dice with face scores respectively as follows : 
1,2,2,3; 2,3,3,4: 3,4,4,5; 4,5,5,6. 
Cite the mean and the variance of 
(a) the u.s.d. of each player's score ; 
(b) the distribution of the score-sum of each player's double toss ; 
(c) the distribution of the score difference of each player's double toss. 


9. Write down the m.g.f. of each of the distributions (а)-(с) above, and specify the frequencies 
of possible score values. 


З. Repeat Exercises 1 and 2 above for the case when the dice have face scores as follows : 
1,2,3,3; 3,4,5,6; 3,5,5,7; 1,4,4,7. 


4. Compare the results of Exercises 1-3 above, and draw your own conclusions w.r.t. what features 
of the u.s.d. are relevant to the character of the 2-fold toss difference distribution. 


14.09 Tue Use or PAIRED DIFFERENCES 


The considerations advanced in 14.08 have a special bearing on the merits and disadvantages 
of pairing observations in one or other way mentioned below. In general, pairing in virtue of 
a similarity relevant to the end in view is always a wise procedure, if the outcome of the experiment 
is so clear-cut that need for statistical analysis does not arise. Otherwise, it is important to 
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realise that pairing presupposes sampling in a stratified universe and sampling in a stratified 
universe may be intractable from the statistical standpoint. 

When we pair data, we conceive the universe as potentially stratified w.r.t. 2 criteria of 
classification, which we may specify as: (i) treatment (columns) ; (ii) within-pair resemblance 
(rows). The following possibilities then arise : 


Case 1. 
'The universe is homogeneous in both dimensions ; 


Case 2. 
the universe is homogeneous in the row dimensions alone, i.e. from pair to pair for 
one and the same treatment ; 


Case 3. 
the universe is homogeneous in the column dimension alone, i.e. for different treatments 
on members of the same pair ; 


Case 4. 
the universe is homogeneous in neither dimension, in which event we have no guarantee 
that the composite sample will provide more than a single sub-sample for any relevant 
parameter. 


Cases 1 and 2 are trivial in this context, since we accomplish (and lose) nothing by pairing 
when corresponding (within column) members of different pairs are unit samples from identical 
sub-universes. Within the framework of appropriate assumptions, Case 3 and Case 4 may each 
be reducible to Case 1 if we employ the method of scoring by paired differences; but there 
appears to be prevalent some misconception about what the appropriate assumptions are. As 
regards Case 3, the relevant issue comes into focus when we examine a distinction between the 
following models. Each type consists of a series of different dice, each of which a player tosses 
twice. We thus have a pair of score values for each die and the stratified universe of which 
our paired scores are stratum-samples is homogeneous in one dimension in virtue of the fact 
that each member of a pair is a unit sample from the same stratum : 


Model I. Four players each toss twice one of four tetrahedral dice with face-scores 
respectively as follows : 
122,3; 23,34; 3, 4, 4, 5; 4, 5, 5, 6 


The variances of the single toss distributions are the same for each die; but the mean scores 
are different, viz. 2, 3, 4 and 5 respectively. For the 2-fold toss the variance of each player's 
score difference distribution is the same, being unity and the mean is zero in each case. 


Model II. Four players each toss twice one of 4 tetrahedral dice with face-scores respec- 


tively as follows : 
142,19, 85-8; Ay быб у 5:5. 75 1,4, 4, 7 


The means of the single toss distributions (2, 45, 5, 4) are different, as are also the variances 
(0-5, 1-25, 2, 4:5). For the 2-fold toss, the mean of each player's difference score is the same, 
being zero; but the variances are different, being respectively 1, 2-5, 4, 9. 

In both series, the mean scores for the 2-fold toss are sample scores from strata with different 
definitive parameters; but this is not true of the score differences as we see from the following 
lay-out in which M is the expected mean score of the stratum and о}, the variance of its distri- 
bution ; d, is the expected score difference and c; the variance of its distribution. 
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Model I Model II 
M 2%, ET M ol CNN 
2 0:250 0 1 2 0:250 0 1 
3 0-250 0 1 45 0:625 0 25 
4 0-250 0 1 5 ro 0 4 
5 0-250 0 \ 4 225 0 9 


. 
Though we have here the variance only, it goes without saying that all the mean moments 
of the stratum d-score distributions are identical for Model 1. Thus the stratum difference 
score distributions are in fact identical. Since sampling from n identical strata is equivalent to 
sampling with replacement from any one of them or sampling from any one of them without 
replacement on the assumption that each stratum is indefinitely large, the Model I universe of 
d-scores is indeed a homogeneous universe. 
In what circumstances we can consider Case 4 as a homogeneous universe will now be 
evident. Our new model will be 


Model III 
Player A tosses once a tetrahedral Player B tosses once a tetrahedral 
die with face scores die with face scores 
1 2 2 3 3 4 4 5 
3 4 4 5 5 6 6 1 
8 9 9 10 10 1 1 12 
16 17 17 18 18 19 19 20 
For this model we have 
M E dy oi 
3 0-25 2 1 
5 0:25 2 1 
10 0-25 2 1 
18 0-25 2 1 


The important common property of Models I and III, viz. : that the universe of d-scores 
is homogeneous, arises from the fact that the row-stratum distributions differ with respect to 
origin alone. This means that there is one source of residual variation. In terms of experimental 
design, such an assumption is admissible when pair to pair variation is attributable to instru- 
mental error as in short-term experiments involving observations of the same subject before and 
after treatment. The expression short-term in this context carries with it the implication that 
no source of relevant individual variation obtrudes within the interval separating successive 
determinations. As a straightforward example of such a situation, we may consider a set of 
paired determinations of blood calcium level respectively carried out on different individuals 
immediately before injection of a fixed dose of parathyroid extract and half an hour later. If 
we view the issue within the traditional framework of the unique null hypothesis, our assumptions 
are then : 

(a) that the scores for successive samples within the period stated differ in virtue of errors 

of observation only ; 

(b) this source of variation is common to all pairs of observations ; 

(c) the mean (true) value of the blood calcium level either before or after treatment is also 

variable from individual to individual in virtue of nature and/or nurture ; 

(d) the expected values of the blood calcium level before and after treatment are identical 

for one and the same individual, 
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A method of pairing commonly practised and commonly advocated has implications very 
different from the foregoing. As an example we may consider its use when the end in view is 
to decide whether addition of a dietetic component to the ration of a mixed population is bene- 
ficial, i.e. growth-promoting, an enquiry which typifies most situations in which the inclination 
to pair observations will obtrude in prophylactic or therapeutic trials. Here the observations 
paired are observations on different individuals chosen because they are alike w.r.t. age, sex, 
body-build, etc. In such circumstances we may have good reasons for believing that variance 
w.rt. growth rate differs sensibly among individuals of opposite sex, of different age groups 
or of dissimilar physique. If so, the d-score distribution varies from row-stratum to row-stratum, 
and the postulates of neither Model I nor Model III hold good. In any case, it will be difficult 
to justify our confidence that they do so without recourse to ad hoc empirical data. Ап experiment 
of Cushny cited by Gossett in his original publication on the ¢-distribution is a somewhat 
unfortunate example of before-and-after-treatment pairing of observations. Here the object 
is to compare two optical isomers of a soporific drug by successive administration to the same 
individual ; but the interval between the observations is inescapably protracted and presumptive 
major sources of variation arise less from liability to error of observation than from change of 
physical conditions. 


CHAPTER 15 


SAMPLING DISTRIBUTIONS 


15.01 THe FUNDAMENTAL DISTRIBUTIONS 


IN a wide range of statistical problems our concern is to explore the implications of the assump- 
tion that parameters estimated from samples are consistent with the null hypothesis that the latter 
come from the same universe or universes of identical structure. Such indices include 
sample means, sample variances, variances of sample means, the ratio of the sample mean to 
the sample variance, and so forth. What conclusions we can legitimately make w.r.t. their 
consistency presupposes knowledge of their distribution. If we can find an exact expression for 
the distribution of a parameter estimate, it will usually be possible to construct a table of its 
integral for ready reference with a view to performing a test of significance ; and expressions 
for a wide range of such sample distributions are in fact deducible, if we assume that the normal 
is the u.s.d. They embrace all those which the school of R. A. Fisher invokes to test the 
significance of estimates of variance dealt with in Chapter 13, and of regression in Chapter 17. 

Indeed, all the significance tests we shall subsequently explore rest on the assumption that 
the putative common universe of the null hypothesis is normal. We have already had occasion 
to remind ourselves that this postulate is at best a good approximation. So it is not necessary 
to emphasise that it is a convenient fiction, In the derivations which follow we may assume its 
truth regardless of its relevance to reality ; and confine our attention to issues which are alge- 
braical rather than factual. From the algebraic viewpoint, each significance test which will 
subsequently engage our attention is referable to one or other of a family of curves 
extensively investigated for the first time by Karl Pearson. 

The common pattern* which Pearson disclosed has little relevance to the end we here have 
in view, and the numbers he attached to the types themselves throw no light on their place in 
modern sampling theory. What is more important from our viewpoint is: (a) the relation 
in which they stand to the normal curve, as indicated symbolically in Fig. 109 ; (b) the fact that 
it is possible to define their properties uniquely in terms of the first 4 moments. In so far as our 
concern is with their role in sampling theory, we may summarise the familial relationship of the 
relevant types as follows : 


(i) With appropriate choice of constants, Type III describes the distribution of the sum 
of n independent square normal scores of zero mean, and is therefore of special relevance 
to the specification of the distribution of sampling variance, as set forth in 16.01—16.03 ; 

(ii) Type VI describes the distribution of the ratio of two independent Type III variates, 
and is therefore of special relevance to the construction of a test (the F-test) for con- 
sistency between independent estimates of variance ; 

(iii) Type VII (on which the t-test mentioned in Chapter 7 of Vol. I relies) describes the 
distribution of the square root of a particular Type VI variate, and therefore stands in 
the same relation to the latter as does the normal distribution to the simplest case 
(Chi-Square for 1 d.f.) of Type Ш; 

(iv) Type I describes the ratio of a Type III variate A to the sum of two independent Type 
III variates A and B. It is a good descriptive curve for the distribution of the raw 
score of large samples drawn from a 2-class universe without replacement ; 


* Pearson developed the equation of a distribution embracing all his Types as special cases from consideration of 
sampling without replacement from a finite 2-class universe, and placed Type I at the head of the list for that reason. 
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(v) Type II is merely the symmetrical form Type I assumes as a particular case and is a 
good descriptive curve for the sample distribution of the product moment coefficient 
r from a bivariate normal universe, when its true value is zero. 


From the foregoing remarks it is evident that the kingpin of the system is Type III of which 
the Chi-Square distribution is a special case. We have already foreshadowed its relation to the 
normal distribution in 14.04. The remaining types are derivable, if we can express the dis- 
tribution of one score which is a function of another in terms of the distribution of the latter. 
This will be our preliminary task in 15.03. First, however, we may usefully recall and elaborate 
previous remarks on what we mean by a variate. 


TYPE Ш (е0 TYPE УГ (ўс. 
eo mz ЗИТ m- ‚тч 
ONE fe ere ii 


TYPE УП (z=vW;m= Сч 


NORMAL (с= /U;k=4=m) 


TYPE IL (nem) RECTANGULAR 
i » у" 
fo Ex Cx! 


Cb.) fot 


Fic. 109. The Family Tree of the Pearson System. (For the rectangular case, n= 1.) 


When we speak of a sample distribution, we presuppose the existence of a set of scores 
(univariate distribution) or of more than one such set (multivariate distribution) which constitute 
what we customarily speak of as the independent variable or variables. In this and the next 
chapter our concern will be only with univariate distributions, in which case what we refer to 
generically as the distribution itself is an expression connecting a particular value (x) of the 
score (variate) with a particular value of a variable y — F(x) (probability density) denoting the 
expected frequency of score values within a specifiable range including x itself. Thus y is what 
we ordinarily call a dependent variable. One reason for using the terms variate and probability 
density is that the words dependent and independent do not have the same meaning in statistics 
as in co-ordinate geometry or algebra. 

When we are talking about the real world, it is highly relevant to be clear about whether our 
scores increase by finite steps (discrete distribution) or otherwise. If they do so, a continuous 
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curve can more or less adequately for practical purposes describe what we can legitimately 
deduce about their frequencies from the theory of probability ; but it cannot do so exactly. 
Descriptive curve fitting of this sort takes its origin from the discoveries of de Moivre, D. 
Bernoulli and other eighteenth-century mathematicians who showed that the normal is a good 
descriptive curve for the exact r-fold sample distribution of the raw-score from a 2-class universe, 
as set forth in Chapter 3 of Vol. I. By hypothesis, the raw-score increases by unit steps, and 
we may then speak with propriety of the ordinate y as that of a frequency curve. Otherwise, as 
we shall now see, the expression is misleading. 


15.02 PROBABILITY DENSITY 


Probability density,* the dependent variable of a sampling distribution, is merely another name 
for the ordinate of the corresponding descriptive curve and the integrand of its area. ‘Thus we 
should properly speak of the equation which specifies the relation between the ordinate y and 
the variate x as a p.d. equation. То get the distinction between frequency and probability 
density into focus, let us now ;ecall the build-up of the histogram of a sample distribution. 

The usefulness of the histogram as a visual device resides solely in the fact that it identifies 
the frequency of a score value or range of score values with an area, and hence clarifies the 
implication of using the integral of a continuous distribution as an approximate means of evaluat- 
ing the expectation of a score value within a specified range. Let us recall what we have already 
learned about it : 

(i) We label the mid-point of the base of each column by a particular score value x which 
increases by equal increments Ax, so that its lower and upper boundaries lie respectively 
at (x — Ах) and (x + 4Ax). 

(ii) The area AA, of a single column, which is the product of its height F(x) and its base 
Ax, specifies the numerical value of the frequency of the corresponding score x, and 
it is not inconsistent with the fact that the function is discrete to speak of this as the 
probability that the score value will be in the range (x + 4Ax). 

(iii) Since frequency here signifies proportionate frequency, the total area of the histogram 
is unity ; and if the score x has values from — a to + b 


z=+b z=+b 
È FoAr=1= >. АА, ; Я Я 3 E 


(iv) If we can find an expression f(x) defining a continuous curve which passes nearly 
through the mid-points at the upper extremity of each column of the histogram, 
having the property that the total area bounded thereby for positive values of x is 
unity, we may write F(x) ~/f(x) for the value of the ordinate at x; and for the 
approximate value of the expectation E(+- a) that x will lie in the range — a to + a 
inclusive 


‘att = 


Ha | одах Ун 


-@+р 
(v) When Ах = 1, i.e. when a discrete score increases by unit steps, F(x) = F(x)Ax and 
there is no need to distinguish between the frequency AA, of the unique score value 
x in the range x + 3Ax and the ordinate F(x) œ f(x) which we shall henceforth call 
the probability density of the distribution. 
* Contemporary usage prescribes the term p.d. only for the ordinate of a continuous variate. This restriction is 


somewhat arbitrary, if only because the continuous variate is itself a fiction and the distinction we emphasise in this 
context is easier to grasp if we approach it against the background of an actual and discrete distribution. 
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(vi) When a discrete score u does not increase by unit steps, we can still visualise its unique 
frequency in the range u + {Ли as the area AA, of a column of a histogram of height 
F(u) on base Au, if we postulate that the total area of the histogram is unity. For a 
range of score values from — a to + b, we must then write 

u=+d u=+d 
> F@Av=1= > AA, . š é j . (iii) 
ua u--a 
If so, the ordinate F(u) of the column whose area defines the frequency of a unique 
u-score value in the interval u + Ли is not identical with its frequency. 
(vii) To define the frequency of a score value explicitly the appropriate expression must 
therefore include as a factor the increment by which it increases. If we postulate 
that it increases continuously from a to b, (iii) will thus take the form 


dA = f(u)du and [roo =] . . : ` - (iv) 


When we say that f(u), a continuous function of a score u, is its probability density, 
we thus mean that y = f(u) defines the ordinate of a smooth curve such that f(u)du 
is the probability that the value of the score itself will lie in the interval и + 0и. 

We may sum up what has gone before as follows : 

(a) The definition of probability implies that the sum of the frequencies of all score values 
of a distribution is unity. If a distribution is continuous, the number of score values 
is infinite; but we can visualise the frequency of score values within a specified range 
as an area on the understanding that the total area under the curve is unity. 

(b) This is consistent with the representation of the frequency of a discrete x-score which 
increases by unit steps as the ordinate F(x) of a histogram column of unit base (Ax = 1), 
because the area F(x)Ax of the column is then equal to the ordinate and the total area 
of the histogram is equal to the sum of the frequencies, i.e. to unity. 

(c) If a discrete u-score increases by steps Au greater or less than unity, it has only one 
value both greater than u — Ли and less than u + Au, and therefore only one value in 
the range и + $Au, We can then represent its frequency in the range и + Au by 
the rectangular area F(u)Au of a column on base Au and of height F(u) so defined that 
the sum of all such areas is unity. 

(d) If the score distribution is continuous, we conceive of F(u)du as an indefinitely small 
element of area under a curve of unit total area, and accordingly define as (Fu) . du the 
probability that и lies within the range и + }du. So defined, F(u) is the ordinate of 
the p.d. curve whose equation is y = F(u). 

Since our first approach to a continuous sampling distribution is the derivation of the normal 
curve, it is of special importance to be clear about what we mean by a normal variate. We 
can derive the normal curve as the limiting contour of the histogram of (q + p)" when r is 
indefinitely large. If so, we can express the frequency F(X)AX of the deviation X of the raw- 


score (x) from its mean M, = rp by the approximate relation : 
2 
F(X)AX = (2zV ,)-* . exp [- ax а 4 d . (y) 
In this case Р(Х) (= Y), the ordinate of the curve for the appropriate value of X, is also its 
approximate frequency. If fy is the frequency of the raw-score deviation (X = x — rp) we 
may therefore write 


1 АХ z 
х= тузі ехр (- a) =, В t í - (vi) 
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This is so because X increases by unit steps from — M, rp to (т — M.) = rq as x itself 
increases by unit steps from 0 to 7. The same successive frequencies which define x = 0, 1, 
2...ralso specify proportionate score values : 


The deviation (U = и — р) of the proportionate score (и) from its mean value (p) thus increases 
by steps AU = r from — p tog. If we substitute AU = 7-1, rU = X and r?V,, = rpg = V 
on the right of (vi) above, it becomes 


fx == (2a7°V,,)-* exp (- x) 


The frequency (fy) of the raw-score deviation (X = rU) is identical with that (fy) of the 
corresponding proportionate score deviation (U) so that 


fy = (2тт?У,)-#ехр (- x) 5 * Е 1 . (vii) 


The form of (vii) is not identical with that of (vi), but we may disclose the sense in which we can 
properly say that the normal is a good descriptive function for both variates (X and U) when we 
express fy in terms of the ordinate (Ур) and base (AU) of the corresponding column of the histo- 
gram for the U-score distribution, i.e. 


Yy. Au = fg = r> . Yy. 
Whence, from (vii) 


Vom UV) tap (- a) . MEE ау 


The last equation is formally identical with (v), ie. F(U) = F(X). Thus the frequency 
equations of 2 nearly normal variates need not be formally identical. We speak of a variate 
A of zero mean as normal if the ordinate (p.d.) equation is normal, i.e. 


F (4)— (27V j) exp (- am. ) 


Similarly, we label a variate as a function of any type by the name of the function which defines 
the p.d. Thus we speak of x as a Gamma variate when we mean that the ordinate y of the 
distribution is expressible as the integrand of a Gamma function (see p. 246). This is at first 
confusing, since it is an inversion of the more common practice of attaching a verbal description 
to the dependent variable, e.g. у is a parabolic function of x if y = Ах? + B. 

The preceding comparison between the build-up of the histogram for the raw-score and 
that of the proportionate score of the r-fold sample distribution from a 2-class universe which is 
both infinite and discrete offers a clue to the problem of defining the p.d. f(U) of a function 
U = ф(Х) of a continuous variate X when we know F(X), the p.d. of X itself. If there is only 
one value of U for each value of X and vice versa, the rule for a discrete variate is implicit in the 
build up of the frequency histogram, viz. : 


F(XJX-KUMAU. . . . . . (i 


of) = Fixe. 
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HISTOGRAM of SQUARE SCORE DEVIATION 
of a BINQMIAL VARIATE (2+2) 


0:200; 


Q-x* o [ 4 9 6 25 36 49 
Frequency о-ва 03492 O-2442 0-1332 0-0555 oor 0:003% 0-0005 
Y ISOMETRIC HISTOGRAM ditto 
0:4001 
i 
o4 Ч 
а 57 9 © 25 36 9 
F@AQ= Aha 
X?=Q: o ! 4 9 6 25 36 49 
AQ: [ ! 5 5 9 9 з з 
F(Q): 0-1964 03492 ооз 00267 ооо; Ооо» ©0003 00000 
F(Q'AQ 0:1964 0:3492 02442 0:1332 0-0585 oom 0:006 0-0005 


Fic. 110. Histogram of the Raw-Score deviation of the 16-fold sample from a symmetrical (p = $ = q) 2-class 
universe. 


In the limit, this is equivalent to the following simple rule when the condition last stated* holds 
good, viz. : 


кох) =U) rr ОЛИС 


* 'The reader will probably recognise (x) as the principle implicit in the familiar trick of integration by substitution ; 
but few elementary textbooks on the infinitesimal calculus emphasise or illustrate, if indeed they mention, that the 
substitution is not always permissible in precisely this form. 
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In the foregoing example, 
; "EE 4 
U-&«X)-—. 

‘Thus one value of X corresponds to one value of U and vice versa throughout the whole 
score range negative and positive. It will be easy to see that this condition is highly relevant 
if we set ourselves the task of visualising the distribution of the square raw-score deviation 
О = ( +X} of the r-fold gums from the infinite 2-class universe. 

It $ 4=qand 7 = =16, as іп Fig. 110, X has zero mean and 17 discrete values 0, + 1, 
+2, +3 + e: +5,+ ‚б, + 7, + 8 with frequencies defined by appropriate terms of (3 + 3)'*, 
©з, 165: 2:15 16. в, 1600 « 2:3 . 164,,.2-5. О has 9 discrete Ap all positive 
0, 1, 4, 9, 16, 25, 36, 49, n with frequencies ‘defined by 16,4) . 2-78, 2. 16 i» . 2.1649. oe zie 

+ 2.164, . 271 . Thus the frequency of the score X =— З is 16, 271 = 0606 -: 165 .2 
which is also the frequency of the score X = + 3; and the frequency of the score О = 9 = ( + ву 
is therefore 2(0-0666) = 0-1332. We can represent the frequency of each Q score other than 
О = 0 as a rectangular column on unit base, if we make the height equal to 2F(X), since 
Q=(+X)*. When О = 0, the appropriate height will be F(O). Such a procedure will leave 
increasing gaps between successive columns from Q — 1 onwards as in the upper half of Fig. 
111. If we were to draw a smooth curve closely following the contour of the frequency polygon 
formed by joining the mid-points at the head of each column, the area of any segment except in 
the interval О = 0 to О = 1 would therefore include that of empty spaces, and would greatly 
exceed the sum of the frequencies of score values in the range cut off by it. 

It is possible to make a histogram of the Q-score distribution uniformly dense (i.e. without 
gaps), if we abandon the luxury of making the columns of equal width (AQ) without relinquishing 
the two fundamental conventions of the histogram of the X-score distribution, viz.: (a) the 


RAW SCORE DEVIATION ond SQUARE SCORE ditto of a BINOMIAL VARIATE 


Fic. 111. Visualisation of the Square Score whose distribution is in Fig. 110. 
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mid-point of the base of each column specifies an actual value of О; (b) the area of the column 
specifies the frequency of the corresponding O-score. 

"The fact that the first two Q scores (Q = 0 and 1) are consecutive dictates how we space the 
boundaries of the columns in conformity with (a). "The boundaries of the columns representing 
these two values are —} to + $ and + 3 to +1}. Thus the half width of the next column 
(О = 4) willbe(4 — 14) = 2} so that AQ, = 5. The base of this column ends at (4 + 23) = 64 
and the half width of the next column (О = 9) will be (9 — 63) = 23, so that AQ, = 5. By 
the same token, the half width of the next column (Q — 16) will be (16 — 113) — 43, so that 
AQ, = 9 and so on. 

Having spaced our columns so that the boundaries of each are equidistant from the point 
which marks the corresponding Q-score on the base line, we can fulfil our second condition 
by defining the height f(Q) of each column in terms of F(X) accordingly. "Thus f(0) := F(0), 
fO) = 2Е(1), ДАЛО, = 2F(2), f(9)AQ, = 2F(3), etc. For instance, 

f(16)^Q,, = 2F(4) = 0-0556, 
2. f(16) = $(0-0556) = 0-0062. 

The values of AQ obtained in this way assume a more suggestive aspect if we place them 

side by side with the corresponding values of X : 


dore GIC S 4-5 6 ri 8 
AQ=1 ace 9 29 IS 13 17 
If we now put the mean values of AQ under the mean value of successive pairs of X-scores we get : 
+Xm=t н A 3 4 5 6€ 7 
AQ, = 1 3 5 7 ӨЛЕ 13 1$. 


We now note that AQ,, = 2X,,, just as 


Such is the build up of the isometric histogram in the lower half of Fig. 111. Let us now ask 
what it suggests. By removing the restrictions that AQ must have a fixed value we have been 
able to eliminate empty spaces between columns, thus leaving open the possibility of expressing 
the sum of successive Q-score frequencies in terms of the area of a segment of a suitable fitting 
curve. Except when О = 0, the following relation then expresses the height of the columns 
of the parent and the derived histogram : 


2F(X)AX = fiQ)AQ, 
^ Ко) = 282. 


Q 
The outcome suggests the following identity in the limit 
dX д 
ҚО) = zr : 5 ‚ x Я - (xi) 


This expression is not identical with (ix), because each value of Q corresponds to two values 
of X (other than X — 0), and the frequency of any value of Q (other than zero) is therefore the 
sum of 2 X-score frequencies, in this case equal because F(X) is a symmetrical function of X 
itself, being a term of the expansion of (3 + 3)". If this is not so, as when the definitive binomial 
of the distribution is (2 + 4)”, we should write 


KQAQ—FC—XAX--FX)AX  . . . . 6d) 
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In the limit this is equivalent to 
O=- z^ aa ху. . x ; . (xii) 


The above defines the p.d. of any continuous variate Q in terms of the p.d. of X when X admits 
numerically equal negative and positive values. ‘The converse case is of equal interest. We now 
suppose that : (a) we know the p.d. F(x) of a score x whose values lie only in the positive range ; 
(b) a score w has numerically equal positive and negative values for each value of x, as when 
w= + xt, so that 


Ж—® ++) = В). mon. 1 > I 


If we have sufficient reason for assuming that f(z) is a symmetrical function of w, we may then 
put 


Ҳо) = M ZEE. - oO 


15.03 FUNCTIONAL TRANSFORMATIONS OF SAMPLE DISTRIBUTIONS 


In 15.01 we have had occasion to remark that 
(a) the significance tests in most common use pre-suppose sampling in a normal universe ; 


(b) each is referable to one or other of a system of curves first investigated from a purely 
formal viewpoint by Karl Pearson ; 

(с) it is possible to exhibit the derivation of any one of them by recourse to some functional 
score transformation of the sort we have now explored in a preliminary way or to 
considerations based on the theory of sampling from a parent universe whose u.s.d. 
we know. 


In 15.02 we have distinguished between 3 situations which arise when we seek an expression 
for the p.d. f(z) of one variate (z) which is a specifiable function d(x) of a second variate x, 
and we also know F(x) the p.d. of x itself. We shall now use as illustrations variates 
assignable to the Pearson system. 

Case I. The variate z = kx is a multiple or submultiple of the variate x so that the two 
distributions differ only w.r.t. scale. "This includes the first example cited in 15.02 and satisfies 
the condition appropriate to (x) therein, since z has only one value for each value of x and vice 
versa. "The rule is 


dx 
Лх) = Е (х) ^ 
Since z = ka when x = a and z = kb when x = b (> a), the corresponding integrals are 
7 b 
| f(z)dz = | F(x)dx. 
ka a 


Tn this case the differential coefficient is a simple scalar factor, i.e. 
dx 
ds = 


©; fle) =] Fle) = К* Fe. 2) I eee dj 
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Example (1).—The standard score is c = (X + c) and 


1 Pe 
F(X) ais exp (- Фа). 
In this case А-1 = c and (i) becomes 
Де) = oF (ec) = (27)-5 e4. 

Case II. The variate z is а single-valued monotonic function of x decreasing as x increases. 
This case also falls into line with (x) of 15.02, since z has one value for each value of xand vice versa. 
"То make clear what we are doing when we use the tabulated functions to specify a segment of 
area, we shall assume that z = a when x = c and z = b when x = d: 


Example (2).—Let x be a score whose p.d. is that of a Beta variate of unlimited range, i.e. Pearson's 
Type VI, defined by 


AD P NN ii 

В, Ю (1+ x)! @) 
We wish to determine f(z) the p.d. of a score defined by 

1 S 

LI EF . (iii) 


As before, F(x)dx is numerically equal to f(z)dz ; but the fact that x increases while z diminishes means 
that c > d if a < b, since b = (1 + d) and а = (1 + с). This means that for all values of d or c 
and corresponding values of b and a, 


b 4 
|| әй = — | F(x)dx. 
a e 
То interpret the sign of the integral correctly we have therefore to put 


- Lo = f(z). 
In accordance with (iii) 
— ул 
(1) =z and = A, 
dx ај EM 
z-a- x 
Whence we have 
а — 2-1 — sy 
TOUT ER OC 
We may therefore write 
stl — zy н 
Ҳа) = € (iv) 


This is an important result, since f(z) is a Beta variate of unit range, being a case of Pearson’s Type I. 


Case ПІ. The parent score x has a symmetrical distribution with two values corresponding 
to one value of u, as when и = ( + x. We shall assume that the range of х is from — oo to 
++ co, so that the range of и is from 0 to оо. Thus x will lie in the range from — d to — с 
and from + c to + d when u lies in the range from a= (+ c)? to b = (+ d)*. This is the 
situation to which (xiii) of 15.02 applies. For any values of c and d with corresponding values 
of a and b, 


b 
a 


INC + f F(jds— | ша. 
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If F(x) is a symmetrical function of x, (xv) of 15.02 holds good, i.e. 
4 b 
zj F(x)dx = f f(u)du. 
е а 


When и = х, so that х = ut 
du. кчы ору Ad 
cs darn oF za 
фи and OF, u> F(x), 
2. Ди) = ut F(x) ` Е S : : vate) 
Example (3).—To find the p.d. of a square normally distributed score deviation. By definition 


F(X) = a exp (5?) and u= X%, 


nV 
1 —u dX = 
eX) v exp Gr) and P b, 
dX = 
^ 2). T7 Jm exp ( z)^ AQ SERE фу 


The particular case where V = 1 is of special interest. If c is the standard score (normal score of unit 
variance) and С = c?, 
dx 
с) = = eH = 235 
dm. Da 
de (» 
+. QF еіс С, 
©-2с^ пр 
[OU T 
ДС) = = ec, S : E б . (vii) 
KC) TG (vii 
"T he last equation is of fundamental importance in sampling theory being the special case of Pearson’s 


Type III known as the distribution of Chi-Square for 1 degree of freedom. It enables us to define the 
expectation of a value of the square standard score not exceeding C = h by the relation 


ЕС <h) = Жж Е осо ОИ ai) 


This is, of course, equivalent to the expectation that c* will not lie outside фе range + УЛ, i.e. 


MI 

-Vi«C«vVlo | eras 
v Jy 

For what follows we shall need to know something about the properties of the curve defined by (vii). 


Accordingly, we determine 
(ЭШ —їс + 300 c-t 
а.о) rp ct eco, 
When the first derivative is zero, we therefore have 
С=—1. 


Thus f(c) has no turning point within its prescribed range. It decreases continuously as C varies from 
0 to oo. 


* It is now common to cite in tabular form the probability that Chi-Square for 1 d.f. will not exceed a particular value, 
It is therefore pertinent to remark that such a table conveys no information we cannot derive from the table of the 
normal function. Thus the probability that a value of Chi-Square (C) will not exceed 9 is simply the probability that 
the numerical value of the standard score с = (x — о) will not be outside the range + 3. 
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Case IV. We now suppose that и has two values for each value of a parent variate x con- 


fining ourselves to the special case и = + Vx. For real values of и that of x must be positive 
and we assume that its range is from 0 to co, so that the range of u is from — oo to + co, whence 
this is the case covered by (xiv) of 15.02, i.e. 


[ F(s)dx = КТ E: [ адаи. 
If we know that f(u) is a symmetrical function of u, (xv) of 15.02 holds good, i.e. 
[ 4F(a)dx = [ уада. 
When u = + Vx so that x = u? s 4 


OIE = и. Fs), 


„. Ди) = u . F(x) = FX) . Я n 5 . (ix) 


Example (4).—We may reverse the procedure of the last example to obtain from (viii) the normal 
distribution of unit variance as that of the square root of the Chi-Square variate (C — c?) for 1 degree of 
freedom. In accordance with (ix) 

Қо) = c. F(C). 
In this expression 


1 1 
С) = ——=е-Є@©.С-+= ——e c 
а V2n А 


5 с.ҢС) = um" = Ко). 


Example (5).—An analogous transformation involves the relation between Pearson's Types VI and 
VII. We define the former in the range x = 0 to x = oo as the p.d. of a score x such that for positive 
values of j and k, 
en a 
80.9 а) 
A case of special interest arises when j = 4, so that 


Fx) = 5] 


таў i а (xi) 
= рр DIR ` о . а E á 
For reasons which we shall mention later this describes the distribution of a statistic whose square root 
(и = Vx) has a symmetrical distribution. Whence, in virtue of (ix), 
1 ux-i 
А gi gj qoe sje 
By substituting х = м2, we thus obtain 
1 
9 = ggg ru 
This is Pearson’s Type VII. By hypothesis the range of и in (xii) is from — co to + oo and f(u) is 
a symmetrical function being equal for numerically identical positive and negative values of u. Hence 
the mean value of и is zero. By differentiating we obtain 
+) _—2 


Pe f= gy gr ere 


(xii) 
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Hence D, . f(u) = 0 when и = 0. Thus the distribution has, like the normal, one mode coincident with 
the mean and extends asymptotically to the u-axis at infinity in both directions. The parent distribution 
whose p.d. is F(x) is a monotonic decreasing function of x from 0 to oo when j = 3, as we see if we 
differentiate (x), i.e. 


р,. F(x) x; BiG — De + 399 (k jy + а) +1). 
Whence D, . F(x) — 0, if 


jeg 

(kl 

Thus there will be a turning point in the positive range x = 0 to x= œ only if j > 1, and the 
distribution is then unimodal. 


x 


15.00 THE PEARSON SYSTEM 


In Chapter 6 of Vol. I we have had a preview of a system of curves suitable for describing 
sampling distributions. "The important types of the Pearson system are the incomplete Gamma 
functions (Type III), incomplete Beta functions (Types I, II and VI) and one derivable from 
the latter (Type VII). The special interest of these functions arises partly from the fact that 
they emerge as approximate expressions for the binomial and the hypergeometric distributions 
when the sample is large, but more especially for a reason stated in Chapter 6. If x is the 
independent variable of the incomplete Gamma or Beta function, the integrand contains a power 
of x as a factor. Hence the zero moments of a variate so defined are of the same form as the 
complete function; and are easily specifiable. It is thus possible to define all the relevant 
constants of such a curve in terms of the moments of a distribution with a view to exploring 
its use as a satisfactory fitting curve. In Chapter 6 of Vol. I, we have examined only the properties 
of Types I-III. In this chapter we shall first recall their properties and then deal with Types 
VI-VII. 


Pearson's Type III. "The complete Gamma function is the integral (n being positive) 
| 272.3071. ds = T(n). 
° 
The fundamental property of T(n) is (p. 246, Vol. I) 


T(n + 1) = nT(n) . г Г : (i) 
5 T(n +2) = (n + 1) (n + 1) = (n + 1)® T(n); 
I(n +3) = (n + 2) T(n + 2) = (п + 2) T(n). 
Whence by iteration, we see that 
Г(п + = (п-т — 1) Г(н) . : . E . (i) 
By the same token, we may write 
Ta -)- 19; 
T(n—2) Г(п — 1) Г(п) 


(n—2) — (а 1)" 


Whence also by iteration : 
аа) T 
I(n—r7)-— G—D® * - . : 5 . (ш) 
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1 E. 


COSI TEE CONC чу s Cic e C EC ME ША i 


Fic. 112. Chi-Square Distributions. The Chi-Square variate of f degrees of freedom is the Type III variate when 
(as here) k = } (or j = 3) in Fig. 109 and n or (m) = 2f. Note that Chi-Square for 2 d.f. (n = 1) is monotonic, but 
Chi-Square for 4 d.f. (n = 2) has a mode in the positive range of the variate. 


In accordance with (i), T(n) = (n — 1)! when n is a positive integer, so that 
Г(2) = 1121-0! — 101). 


If n is a negative integer Г(н) = + оо. When n = 3, T(n) = Vz, whence from (i) 
Гф) = Ут; rd -ivs; 
PG) = ут; ГТФ) = M Vw. ee @) 
It is convenient to express the complete Gamma function in ће more general form 
| ede — 35 Е : 2 ^ 9 


А" I Ра 1 
E e Pn Mx = 1. 
Г 
Accordingly we define а Gamma variate of scale k and exponent (n — 1) ав a score x whose prob- 
ability density is given by 
kre ttyl > 
f(x) = CORE С 2 : : 2 . (vi) 
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This is the p.d. equation of Pearson's Type III in the range x = 0 to x = co. Ву definition, 
the rth zero moment is given by 


FN i 1 
= —kzyn e r— Ydy. 
Br ns]. PIE dx, 


I Гв) 
DE ВО егеу ртс лаш 


Hence from (ii) 
p, = (п +r — 1)? "EUM у 


In the same way we may derive the negative zero moments defined by (vi) in 11.03, viz. : 


ke [eu .dx 


E-r = Teo 
k I(n—r) 
=T m 
Whence from (iii) above 
к 


атл - (viii) 
From (vii) and (viii) it is possible to obtain the moments of the distribution of a score z which is 
the ratio of two independent sample scores и and v, each a Gamma variate, i.e. 


узсе; A : : E E . (ix) 


Our interest in this function arises from the fact that an important class of significance tests 
depends on the distribution of the ratio of sums of squares, and that the distribution of a sum 
of square normally distributed scores is of Type III. For that reason we need consider only 
the case of two variates и and v with the same scalar constant А, i.e. 


kw.e-ce um oe gat 


тыт у шс 


If u and v are independent variates, we may employ (vii) of 11.03 to obtain the moments of z, 
16; 
ҥ+(®) = phu). p- A0) . 5 : A е ne (x) 
From (vii) and (viii) we obtain 
ndi) = Вт +r — 1); 
к 
в- (2) = ape 


Whence by substitution in (x), we get a result which we shall later see to be important : 


u\ (m-c-r—10 š 
„(ә = сураи - . > > < (ш) 
From (vii), we derive the following values of the zero moments of the Gamma function : 


a (+ (1-20 (nigro 
а= ids р} р}! | 
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We now recall (xxx) in 11.02, viz. : 
m, = pe — uh 
тз = из — Зи». py + 2? ; 
m, = py — Арза + биз. ш? — Зи“. 
Whence we derive 
m, = nk-*; m, = 2nk-? ; m, = 3n(n + 2)k-*, 


= 3(1 + 38) AUTEM T ee 


= к=з: В. =3 


From (xii) we see that f, suffices to define f», and that В, > 3, and the distribution is both 
skew and leptokurtic. When z is very large, the first two Pearson coefficients do not sensibly 
differ from those of the normal curve. By differentiating to obtain the maximum value of f(x), 
we can obtain the distance of the mode from the origin : 


DAA = (n — 1)е =. x" - — ke n. 
Whence D,f(x) = 0 when 


. (xiii) 


‘The distance between the mode and mean is 


n—1 n—l n T 

k m QE: ee 2 Е 5 . (xiv) 
For the distribution we have elsewhere (р. 644) called Chi-Square for 1 d.f., А = } = n and 
x in (xiii) is negative, i.e. there is no mode in the positive range, the curve being monotonic. 
The Туре III distribution is indeed unimodal only if n > 1. From (xiv) we then see that the 
mode is to the left of the mean, the distribution being therefore most steep on the side nearest 
the origin. More generally, we speak of the Type III distribution defined by (vi) above as the 
Chi-Square distribution for 2n degrees of freedom when k = }. Thus Chi-Square for 2 d.f. is 
also monotonic, since л = 1 and x = 0 in (xiii) ; but Chi-Square for 3 d.f. has a maximum value 
in the positive range, since л = $ and (л — 1) = 4. 

Evidently, the relation B, = 3(1 + 48,) restricts the suitability of the Type III distribution 
as a good fitting curve for a distribution which is both skew and leptokurtic. Its special interest 
for our purpose arises from the circumstance that it includes the Chi-Square distributions as 
a special case when k = }; and the importance of the latter resides in the fact that they describe 
the distribution of the square deviation (Chi-Square for 1 d.f.) of a normal variate and (as we shall 
later see) for the sum of f independent square normal score deviations of unit variance (Chi- 
Square for f degrees of freedom). Hence it is of fundamental relevance to statistical problems 
involving the distribution of variance estimates. 

Since f = 2n by definition, we write Type III in Chi-Square form as 

9-0 e-i Xi 9) 
Бү у= Ары. рани 
DUE 7 


From (vii) we obtain the zero moments of the distribution as 


m=f; pa — fü 2); pa =f +H; n = fü + WF + 40 + 6), ete. 
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Types I and П. The complete Beta function is expressible* alternatively as an integral 
of limited or unlimited range, viz. : 


[57a x) dx = B(j, k) | 


o xil 
Bus ut A 5 . (xv) 


The Beta function B(j, k) is expressible in terms of the Gamma function, viz. : 


Га) TR) 
b k) == Я 
(G, k) TGF K 
We may adapt as follows the left-hand expression of (xv) to define a variate of restricted range 
from 0 to a 


| aHa — s} -Ide = а++-1В(ј, k) . š i . (xvi) 
° 


Accordingly, we may define a Beta variate of restricted range by the equation 
аа a 
IO) 7 FT BGR) 

Equation (xvii) defines Pearson’s Type I of which Type II is a special case when j = k, so that 


(xvii) 


(xviii) 


The general expression for the zero moments is 
M [ trl (a— x}. de 
QUID SUC UIDES 
анг; + ”Г( + k) a(j+ $c т) 
PT WHAT kr G+k+r—I" 
Whence the mean of the distribution is 


(xix) 


On differentiating f(x) in (xvii) we get 


d Б md Beo =, k— TS ы 2 
2, je Оа T E ec 


Hence D, . f(x) — 0 when 


— a — 1) 
x See 
This defines a turning point (maximum) within the prescribed positive range if j and k, being 
greater than unity, are (as we here assume) of the same sign, viz. positive. The score value 
(x) so defined is then that at the mode and (x — ду) is the distance of the mode from the mean, 
so that 
а] — 1) aj a(j — k) 
jtk—2 jk (АЕ 2) 


* j and k being positive. 
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TYPE I 


e jt LK 
$ Ysgo" €? мока 


n 


O0 o? бї 06 O8 10 


Fic. 113. Pearson’s Type I (often a good approximation for the hypergeometric distribution for sampling without 
replacement in a 2-class universe). 


Thus x > ш and the mode lies to the right of the mean if j > k, otherwise to the left of it. The 
mode is the midpoint of the range and the distribution is symmetrical if x = ła, i.e. if j = k, 
when ш = За and the mean coincides with the mode. As we have seen, this condition defines 
Pearson's Type II as a special case of Type I of which (xviii) is the definitive equation. From 
(xvi) we obtain the first four zero moments of Type II as 


озше cnet aj + Зу 
DLE Hm CESI Hs G+? + Ba 2j 4-3)9* 


Accordingly, we derive 


m. ia т,=0; т зз 
TAGAD ^ Co* 162 + NA+ 3) 
We thus obtain 
6 
B,—0 and B=3— те: E x B ; xx) 


8* 
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From (xx) it is evident that Type II describes a platykurtic distribution (B, < 3) for all positive 
values of j; and that the values of the first two Pearson coefficients are identical with those of 
the normal when j is indefinitely large. We shall explore its relation to Type III on p. 658 
after we have examined the properties of Type VI. 
From (xix) we obtain in the usual way the following values for the mean moments of the 
more general (Type I) distribution : 
E ту _ PPM) _. 
t (%®+}(#+7+1#' > REPRE EFF QD 
Satjk[jk(j + k + 2) + 2(k — jy] 
(k +] + 3y" (jy ` 


TYPE П 
у= LL x^ (123))7 
К) Gi) 


Fic. 114. Pearson’s Type II. 


Whence we have 
в -Petit 
СЕРИ 
DE 6[Ж(# +j + 2) — (k — Dk +j + 1] 
i Aik +j +3)? е 
For positive values of k and j greater than unity, we have seen that Туре I is а unimodal distri- 
bution. It may then be platykurtic, but will be leptokurtic if very skew. The condition that 
В» > З is evidently 


(6—06 +j + 1) > kik +j + 2). 
If & — gj Eye li 
(q — 1 (g - 1.5 - 1) 7 49+1.3+ 2). 


"Thus, e.g., the curve is leptokurtic if g = 4 when j = 2sothatk = 8. As an exercise the student 
may profitably explore the condition that В, = 3, and the condition (k = 1) that (xvii) defines 
a monotonic increasing function, the mode being then at the upper limit of the range. 

The Type VI distribution. Types I and II define a distribution of restricted range in 
virtue of the integral limits of (xvi), i.e. from 0 to a. We now recall the alternative definition 
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(p. 251, Vol. I) of the Beta function on the right of (xv), which we may write in a more 
general form as 


т E mde. (oxi) 
Bim, n)), (k + xv" — id 2 Е Е : 
Accordingly, we may define a Beta variate of unrestricted range in the positive domain as 


22 $ 
f(x) = Bn, nk F y" ERE EER (REIL) 
This is Pearson’s Type VI, the special interest of which emerges from a consideration 
For the rth zero moment of such a distribution we have by definition 
ко fo pima 
Br Ben, al {кў 
To get the integral in the expression on the right into the same form as (xxi) we may put 
(r + т) = z, so that m = (z — r) and 


of its moments. 


k © x 
D Be) obs 
__# Bæn- 
B(m,n) k" 
т В тп) 


x Bim, n)" eo 
k"T(m +n) I(r + т)Г(п — т) 
Tomi) Тт n) 
.. RT + m)I'(n — т) 
T(m()  ' 


9 тую 
7 p= E a m Ov peat age eid си) 


jc 
Bin ano" 


mzIO n=5 


9% o2 O4 O6 Ов 10 г 14 16 18 
Fic. 115. Pearson’s Type VI (Snedecor's F—see p. 700). 
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In particular when k = 1 
(mar — 1)? 
Ке = 010) 
"The last equation is identical with (хі), i.e. Type VI defines the distribution of а variate which 
is the ratio of two independent Chi-Square variates. 
In this case, the two Gamma variates of whose ratio Type VI describes the distribution 
have the same scalar constant. We may make (хі) more general if we write 


p" : e” n un q" T ew b ge 
sos FE and fo) = f 
In this case 
i) = pen +r — T)? and we) = уь 


. . . . . . (xxiv) 


G- est 
нА) 09) Rm 
This is equivalent to (xxiii) if we write in (xxiv) 


ket 
Ё 


From our viewpoint the last remarks pinpoint what is important about Pearson's Type ҮІ; 
but we may profitably pause to comment on the general properties of the distribution defined 
by (xxii), if only because Pearson, to whose genius we owe the technique of curve-fitting by 
moments, elected to disguise his types in symbols best fitted to conceal from the student their 
most interesting properties. We have indeed exhibited in 6.08 of Vol. I the customary equation 
of Type III with origin at the mode, and hence identifiable only at the expense of some effort 
with the Chi-Square distributions. It is equally possible to conceal the fact that Type VI is 
merely the Beta variate of unrestricted range, if we shift the origin to the left of the point 
where the curve starts off by the substitution (k + x) = X and x = (X — k). If we then put 
(m + п) = p and (m — 1) = ф we may write (xxii) without any obvious advantage in the form 

k-2-«x1 
?~BG@+1p—¢— 
(q--l,p—4 
This is the form of Type VI commonly cited in standard works. 

What is more worthy of comment is the character of the distribution which (xxii) specifies. 

By definition the range is infinite. On differentiating once we obtain 


px "X — 9r. 


Diy dioc ze Tm -*k + ж) т" — (m + п)" + x) - 7-1). 


On equating to zero in the usual way we obtain 
(т — 1)х"-2 (m+ n)x™-1 
(k + х)" *n (k+ x)” tny’ 
| (т — Vk 
х= п + 1 . 


If m> 1, there is therefore a single mode in the positive domain which confines the variate. 
Subject to this condition, f(x) = 0 when х = 0. If m < 1, the curve is J-shaped in the domain 
of positive values of x and the turning point lies outside the range of the variate. 
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The expression J-shaped in this context is current usage ; and it is not an altogether happy 
one, since the capital J has an upward bend at its extremity. Like the rectangular hyperbola, 
the curve under discussion tails off monotonically from a flying start. A J-case of particular 
interest arises when m = } and k = 1, so that 


m il xi 
TU Berg 
This we shall see is the parent of Type VII. When the Type VI curve is unimodal in the 


positive domain, we may explore its shape by evaluating the first four moments. We may dis- 
regard the scalar constant by putting & — 1, in which case we obtain from (xxiii) 


(xxv) 


Ew e o mm-l . 
ces BG)’ 
m(m--Y(m--2) . m(m + 1)(m + 2)(m + 3) 


Ва 6—129—29—3) " a a= 2)(n — 3)(n — 4y 


Hence we obtain the mean moments in the usual way : 


m(m--n—1). 2m(2m + n — Y(m +n — 1). 
mir EUER "s (n — yn — 2у® ; 
_ Sm(m +n — 1) 


m = {m(n + 5)(m + n — 1) + 2(n — 1). 


(п — 1)(n — 2) 
Thus the first two Pearson coefficients are 


_ An — 2)(2m +n — 1)°, 
Ph EEDA у 


(п + 5\(л — 2) An — 1y(n — 2) 
P. s =з) aari- a-a zl: 


For positive values of m and n each greater than unity, the distribution, as we have seen it 
to be, is unimodal. The second mean moment is infinite if n = 1 or n = 2, the same being 
true of the third if n = 1 or n = 2 or n = 3 and of the fourth if n = 1, n = 2, n = 3 or n = 4. 
For values of m greater than unity and of n greater than 4, the value of B, is greater than 3. 
For integral positive values of both m and n Type VI cannot therefore define a platykurtic 
distribution. 

Type VII. The distribution last dealt with is that of the variance ratio of Chapter 16, and as 
such the basis of Snedecor's F-test. The #-distribution commonly called Student's in conformity 
with the pen-name of its author, W. S. Gossett, is Pearson's Type VII. To clarify its genesis, 
we may remind ourselves of the relation between the normal distribution of the c-score of unit 
variance and the distribution of its square (C = c*), i.e. Chi-Square for 1 d.f. We may express 
this relation by saying that the normal distribution of unit variance is that of the square root 
of a Chi-Square variate of 1 d.f., and might permissibly speak of the latter as the parent of the 
normal distribution. The particular form Туре VI assumes when k = 1 and m = 3 in (xxii) 
is the parent of Type VII in the same sense. The Type VI distribution then defines a variate 
х = 2°, such that 


1 x-i 
IO = Baw aye 
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'This is a monotonic decreasing function of x in the positive range of the distribution, like Chi- 
Square for 1 d.f. On the assumption that the distribution of ж = x! is symmetrical, we have 
seen how to obtain the distribution of z from that of x in Example (v) of 15.03, as below. 


B 
rO Qj s capt 
E $z- dz? 
1 P 
= F(z) = BRR 2 E 5 : . (xxvi) 


This is the definitive equation of the Type VII distribution which is evidently symmetrical about 
zero mean. Hence odd mean moments vanish, and we can define the even mean moments by 
2 ji at. dz 


Mar = Bg, н) ), CE 


TYPE VII 


-+O -05 о o5 Io 
Fic. 116, Pearson's Type VII (Student's t—see p. 655). 


We can get this integral into Type VI shape by the substitution 2° = и, so that 


ы ig wt. du 
"ar = Bn), TF at 
We now put (r — 3) = (j — 1), so that j = (r + 3) and (k + j) = (n + 4) so that k = (n — r), 
whence 
В+ п) 
аа у 
Ге + Гә — 7) 
| dre * 
-e° 


= (6 — 19 А 5 5 A $ . (xxvii) 


SAMPLING DISTRIBUTIONS 657 


Whence we obtain 


EE, 3 no 15 
m= jg) еро) а= == 3). 
The Student or t-distribution is a particular case of (xxvi) involving a scalar change, viz. : 
z= 5 and f — 2m. 
Whence by substitution in (xxvi) 
1 
А0 =— T RESA (xxviii 
vj. вал (1 +5) 
For the moments we therefore write 
maíz) = "0 or ma(t) =f" тах). 
Hence from (xxvii) 
7.609 
oc gym 
Whence we obtain 
E UO 15/* 
™ = F—3' "cg-sa-q-ay ™ (7—27 007—9) 
‘Thus we get 
3f—2) 37—4+2) 6 | 
aay g-9 tA me 
15(f— 2)? — 30(3f — 10) 
A-g-2r-8 ^ (-40-9 = 


If f > 4 the curve described by (xxviii) is leptokurtic, since В, > 3. When f = 2 the variance 
is infinite. 

It is also evident that the fourth mean moment is infinite if either f = 2 or f = 4. Of more 
interest is how closely it approaches the normal when f is large. From the preceding formulae 
we derive 


f B. В, Be 

16 35 24-5 300-1 
22 3:3 20-8 208-0 
40 3-16 17-7 147-1 
60 31 16-7 130-3 
Normal 3-0 15-0 105-0 


At the 2c level the correspondence between the normal and the £-distribution is very close when 
f 50. 
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Relation of the Type VII and Type I distributions. We may now define as follows a variate 
(w) which exhibits the genetic relationship between Types I and VI, hence also between Types I 
or II and Type III, as in Fig. 109 : 
1 v 


w = — = —. 
1+2 v+u 


We can determine the p.d. equation for the score w, if we know that of z, which we may assume 
to bea Type VI variate. The derivation proceeds as in Example (2) of 15.08, viz. : 


1 gi-i 


T0 T ELE DERE! 
u*-]1 — q)-1 
fe) - T p (о) 


The variate z = (и + v) is itself a Type VI variate if и and v are independent Type III variates. 
If u and v are Type III variates with equal scalar constants k = j, as is true of the Chi-Square 
class, the last expression reduces to the Type II form 


wi-(1 — v) 
w) =—_— 
dA CU 
We shall later see that this defines the distribution of the correlation ratio (5) in a homogeneous 
normal universe (p. 706). 


(cdi) 


EXERCISE 15.04 


1. Show that the ratio (x = A + B) of two Chi-Square variates, A of a degrees of freedom and B 
of b degrees of freedom is a Type VI of the form 


ИТЕ) 
IO) = Бш үт F xe 


e uia- 2) 
a 


b dac 
Ba (2 +) 
8. If z is the reciprocal of и in 2 above, employ the method of 15.02 to show that 


aye gio -9 
b 


Bib. do E "dh Té 


9. Ifu = ax — b in the above, show that 


Хи) = 


Ҳа) = 


4. Show that the first four zero moments of the Chi-Square variate for f degrees of freedom аге 
“=f; рь — ff - 2); 
Bs = Д/+2)(/+ 4); pa = fü -- 20 -- 4) 4-6). 


SAMPLING DISTRIBUTIONS 659 


15.05 THE TABULATION OF THE GAMMA FUNCTION 


The mere fact that the incomplete Gamma and Beta functions are suitable to describe unimodal 
distributions whose zero moments are always expressible in terms of the complete Gamma 
function would not justify their prominent role in statistical theory, if it were not also true that 
they satisfy the practical demands of ready tabulation; and we have hitherto (6.05, Vol. I) 
indicated the numerical evaluation of Г(п) only when n is a positive integer or an odd integer 
multiple of 3, negative or positive. The aim of Chance and Choice is to put the playing cards 
of statistics face upwards on the classroom table; and we should fail to fulfil it if we gave no 
indication of how it is possible to construct a table of T(n) for all values. 

What we may call the official procedure relies on the possibility of expressing the Beta 
function as a trigonometrical integral in accordance with (iii) of 6.07 in Vol. I; but it will 
suffice for our purpose if we take advantage of the method employed in 6.02 to exhibit the 
possibility of evaluating the normal integral and of obtaining the standard score which corresponds 
to the so-called probable error. To do this, we made use of the method of integration by series, 
a trick which is always justifiable if we can express the integrand as a convergent series, and always 
convenient if the series converges rapidly. It is not easy to fulfil the last condition but the 
following example will suffice to show that it is possible to evaluate T(n) for fractional values of 
п other than n = 3. We first note that 


1 
B(n, n) — | an-Y(1 — x) -dx 


o 


[ea п — lx +2 — 1 — n — lax? . . .)dx 
° 


1 == —— — 
| (a-i — n — ух" + 2 — legat —n—1lgxn**.. .)йх 
о 


ЕЗ E (n— 1 (и — 1) "+2 — (n— Dans ji 


n (в + 1) 2'(n + 2) 3(n--3) ''' d, 
"tse; тув" 
= zc Doe Ne se a Кш. бф 


Let us now suppose that we wish to find the value of Г($) or Г(— 4) 


aa,» =. 
Since 
га) = + 1) = 40) = 4V7; 
T) = УЗВ@, Do) EE ter qai) 
Likewise 


Zu edd HTC 
«NH= VBE . . .  . (d) 


660 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


In (i) we now insert the value n = j, so that (n + 7) = }(4r + 3), and 


ио 45 ио = КЕ) FG 
9 


(—-1)9- – 64—10 0-2= GGG 


and in general 


(n — 1? = (— 1). a TT (ae EP. dee ye ee ee EU 
z-1 
For brevity we may write 
(т 0 
n(n r) 
Te-a 
D UR d а р ? feat) 
714' (4r + 3) 


K, 


"Thus (i) becomes 


r= 


Bi) = УОК EE ram) 


r-0 
‘The series so defined is convergent. From (v) we obtain 


1.5 1.5.9 
Wan = 98: Ка=5[д gg = e 


Ky $; К, +; к, 


1.5.9.13 2. 1.5.9.13.17 — 
K=p 0 or gau 0009 
After the first 5 terms the fall-off is very slow. ‘The first 12 terms add up to 1-64067. If 
we insert this value and that of Ут œ 1.7725 in (ii) we get I'(1) 1-21 a result correct to 
2 significant figures only, the correct value to 5 significant figures being 1.2255. The sum of 
the first 36 terms yields the value 1:2162 which is correct to 3 significant figures. 


15.06 SCORE-SUM AND MEAN SCORE OF A SAMPLE FROM A GAMMA 
UNIVERSE 


We shall now proceed to establish what is the most important property of a Gamma universe 
in connexion with the theory of sample distributions. By a Gamma universe we imply a unit 
sample distribution specified by the Gamma variate whose p.d. equation is : 


Be eS 4 
у= — Tap us 3 5 s . @) 
The first zero moment and the mean moments are as derived from (vii) in 15.04, viz. : 
а = kn m, = 3k-^n(n + 2) 
m, = k-n ms = Ak-*n(5n + 6) 


ту = 2k-n m = Sk-*n(8n? + 26n + 24). 
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Whence we have 
8(5л + 6) 


4 2 
В, = au Bs = (ii) 
10(13n + 12) 


n? 


Gii) 


; B, = 15 + 


We now recall results obtained in 14.05 (viii)-(xi). For the Pearson coefficients of the t-fold 
sample score-sum we write accordingly : 


B.—3. 


TID 


1 
wh = 78 ; Вә =3 + 


wbs E EI +5835 


‚ 1t — 1)(B2 — 3) + (Ba — 15) + 10(t — Df, 
! m $ 


wbi = 15 


By substitution from (ii) and (iii) in the above, we get 


4 5nt + 6) : 
“В, = з “Ёз = mero (iv) 
6 10(13nt + 12 
wh =3+5; A= 154+ A 12 6) 


In these expressions nt replaces n of (ii) and (iii) above. "Thus they define the first 4 Pearson 
coefficients of a unit sample distribution defined by 


jm eH BS | gnt-1 


T(nt) i2) 


KS) = 
"This result suggests the following important rule : if the unit sample distribution is that of a Gamma 
variate, we obtain the distribution of the score-sum of the t-fold sample by substitution of (tn) for 
n in the exponent of the expression definitive of the distribution of the unit sample. If we put k = 4 
and л = 1f in (i), we have k = 3 and nt = 4/2 in (vi). We may therefore express the preceding 
rule by the statement : if the unit sample distribution of a universe is a Chi-Square variate of f 
degrees of freedom, that of the t-fold sample score-sum (and hence mean) is a Chi-Square variate 
of ft degrees of freedom, and hence the sum of ? independent square normal standard scores 
is a Chi-Square variate of t degrees of freedom, i.e. 


E. eis, sin Ó 

Д5) = элн). > : 2 А - (vii) 

The preceding derivation does not constitute a watertight proof of the rule, though it shows 

that (vi) is likely to give a very good fitting curve for the t-fold score-sum (S) distribution of a 

sample from the universe of which (i) defines that of the unit sample. We can establish in 

more than one way the conclusion that all the moments of the S-distribution and hence also 
the Pearson coefficients of any order are identical with those of (vi). 


662 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


We first suppose that A and B are Gamma variates with the same scalar constant k, 


defined by 
k y к" 
To 4^7! and F(B) = TO 


+. (A) = Еп 4- r — 1) and p(B) = Ет +r — 1)”. 


For the moments of the score-sum distribution of independent samples whose distributions 
conform to the above we have 


да+ B) = EA + BY =È пБ). BB), 


F(A) = 


— kB рт —1 
В", 


аа B) = "Sry HA) er dB) 


z-r 


=k" € т (п +x — 1) (m+ r—«— 1)", 
т=0 


Р E аа (m+r—x—1)" 
“+ pA + B)=k* 2m EN GA шшш 
In the notation of Chapter 1 of Vol. I this expression involves a product of Figurates, viz. : 


ce 
нА + B) = к". п S Fn "Fn. 


z-0 
Whence from (x) in 11.07 
pA + B) = Е". т Furm = RO (n+ т т — y 
The above expression defines the moments of the distribution of a score C(= A + B) defined 
by the Gamma variate 
knim 
Е(С e 9? Cim, 
© дат)“ 

Thus the score-sum of a I'(n) and of a T(m) variate is a Г(л + m) variate. Hence that of 
two T(n) variates as defined by (i) is that of a Г(2л) variate, that of three T(n) variates is a Г(Зп) 
variate and so on. 

Alternatively, we may reach the same result by recourse to the moment generating function 
of the Gamma variate. If f(x) is the p.d. of a variate x whose range is from 0 to оо, the m.g.f. 
of the distribution is given by 


© 
Glu) = | e f(x) . dx. 
0 
For the m.g.f. of the unit sample distribution defined by (i) above, we therefore have 


А" co Ee el 
Tel, e £2 yn- dy 
м To) 

“Te 0° 


G(u) = 


t 


~ Gu) = (6—0) = (1 = JE 
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The m.g.f. of the s-fold score-sum sample distribution in accordance with (iii) of 14.02 is therefore 
"ne 
e4)-(1-1) - 


We obtain the general expression for the moments of the distribution of the score-sum of 
the s-fold sample as in 14.04 by recourse to the relation 


а" 
Ш. = q C when t = 0. 


By successive differentiation we have 


2.040) (п + r — 1) je" (k — i)", 


oe ре Ke" (т т 1). 


This defines the moments of the distribution in which sz replaces л of (i) above. Thus the score- 
sum of an s-fold sample from a T(n) universe is a I'(sn) variate. 


The so-called Chi-Square Test. It will forestall misunderstanding at a later stage if we take this 
opportunity to comment on the use of the expression Chi-Square test, recalling earlier remarks on the 
c-test. In different chapters of Vol. I we have referred to a c-test with judicious use of the indefinite 
article. A c-test is a test we can rightly apply to a score whose distribution is approximately normal ; 
but whether a score distribution approximates to the normal form and with what order of precision is a 
matter for separate enquiry with due regard to the nature of the score. The normal curve is what the 
Herbals describe as a protean genus which turns up in unlikely localities ; and the rationale for invoking 
it in one context, e.g. quality control, has no intrinsic relation to the reasor for enlisting its aid in another, 
e.g. the proportionate score difference of two sub-samples. 

Similar remarks apply with equal force to what many current treatises refer to as the Chi-Square 
(x°) test. The expression recalls a well-known comment on the Lord Privy Seal, a personage who is not 
necessarily a lord, never a privy and in no sense a seal. А species of the Pearson Type ПІ genus turns 
up as a sampling distribution in diverse situations for reasons just as diverse ; and tables of the corre- 
sponding integral are in use to test many different hypotheses. The statistic commonly referred 
to as Chi-Square is in fact a sum of squares, and is not itself a square, except when we speak as below 
of Chi-Square for 1 degree of freedom. 


* * * * * * * 


Pooling Data. The additive property of the Chi-Square variate set forth in this section 
calls for a caveat w.r.t. a recipe sometimes, and in the opinion of the writer wrongly, cited for 
situations in which the end in view is to assess the significance of an assemblage of normal tests 
the result of none of which is highly significant per se. We have seen that a normal test, i.e. 
a c-test, is on all fours with a Chi-Square test for 1 d.f. if we use the table of the latter to assess 
the probability of getting a score as great as с? = С; but we have to take something for granted 
when we do this. By squaring c we eliminate the sign difference. Hence assessing the prob- 
ability that the sum of a set of c-scores (e.g. d, = 1-50,, da = 2-1os, ds = 1:90, etc.), each refer- 
able to a difference in the same direction though each or most of them numerically too low to 
inspire confidence, will attain its particular numerical value is not on all fours with assessing the 
probability that a sum of Chi-Square variates will have a particular numerical value. 

In such a situation, elementary considerations may supply the answer we seek. For instance, 
we may suppose that we perform six experiments or make six sets of observations involving a 
difference, e.g. percentage of persons not attacked in an epidemic when treated in one or other 
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of two ways. "The result of all six observations might record a difference in favour of one treat- 
ment rather than the other, but no such difference might be large enough in comparison with its 
own estimated s.d. to constitute what we usually regard as a significant result. In this case we 
may argue as follows. "То say that there is no true difference signifies that a difference in one 
direction or the other is equally likely on any one occasion. Thus our null hypothesis assigns 
р = 4 as the probability of getting a difference whose sign is positive in a single trial. The 
likelihood of getting six out of six results of this sort is (3)*, i.e. the adverse odds are 63: 1. This 
is an exacting test to apply to the pooled data, and might fail to restore confidence. If so, we 
may proceed as follows. 

On the assumption that c, = (d, + оу), сә = (ds + оз), etc. are approximately distributed 
as normal variates of unit variance, their sum s = (c + cy . . . Cn) is itself a normal variate of 
variance л, so that с, = (s + V п) is itself a normal variate of unit variance. Since 
also the difference between two normal variates is a normal variate whose variance is the 
same as that of their sum, the validity of this procedure does not presuppose that every difference 
has the same sign. If our pool includes one or more negative values, the value of c, will of course 
be smaller than it could otherwise be; but this does not affect the rationale of the c-test. 
Evidently, this is not true of the sum of the square standard scores, i.e. the sum of Chi-Square, 
the value of which will be exactly the same if all the differences point in one direction and if 
equal numbers point one way or the other. 


Distribution of the Mean Score. If S in (vii) is the score-sum of the t-fold sample, the mean 
score (M) is given by S = tM. We may obtain the p.d. equation of the mean score by recourse 
to the substitution of Case I in 15.02, viz. : 


F(M) —f(S). FA =2.(5). 
Thus (vii) becomes 
t 1-2 
(e*t 
(at) 


The last equation defines the distribution of the mean value of t independent square scores. 


F(M) = ре ee 


EXERCISE 15.06 


l. Examine the results of pooling the following data cited by Major Greenwood (Epidemics and 
Crowd Diseases) in connexion with the possibility that a summer attack of influenza conferred immunity 
during an autumn epidemic among schoolboys : (a) by pooling all the raw data ; (5) by pooling the critical 
ratios ; 


Eton. 393 attacked in summer, of these 29 (7-4 per cent.) attacked in autumn ; 360 not attacked 
in summer, of these 172 (47-8 per cent.) attacked in autumn. 


Harrow. 90 attacked in summer, of these 29 (32-0 per cent.) attacked in autumn ; 339 not attacked 
in summer, of these 258 (76-1 per cent.) attacked in autumn. 


Clifton. 162 attacked in summer, of these 22 (13-6 per cent.) attacked in autumn ; 289 not attacked 
in summer, of these 99 (34-3 per cent.) attacked in autumn. 


Haileybury. 180 attacked in summer, of these 41 (22-8 per cent.) attacked in autumn ; 335 not 
attacked in summer, of these 73 (21-8 per cent.) attacked in autumn. 
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2. In the same way analyse the following data compiled by Greenwood, w.r.t. efficacy of prophy- 
lactic inoculation, from official returns of the Western Front 1914-18. 


Incidence Death-rate Case Mortality Number of Cases 
per 1000 per 1000 per 1000 
Year Disease 
Pro- | Unpro- | Pro- | Unpro- | Pro- | Unpro- | Pro- | Unpro- 
tected tected tected tected tected tected tected tected 
‘Typhoid 58 17-3 51 202 
1914 Para A — — — 5 
Рага B — = — — -— 32 Бы 31 
‘Typhoid 0-93 84 0-007 18 75 23-2 517 288 
1915 Para A — 0-4 — 0-003. — 0:7 — 281 
Para B — 17 — 0-03 = 1-9 — 1043 
Typhoid 0-57 0-51 0-009 0-04 1-58 8-33 693 36 
1916 Para A 0:21 3-19 0-003 0-05 1-56 1-78 256 224 
Рага В 0-3 9-2 0-002 0-07 0-82 0-77 362 647 
Typhoid 0-104 1-09 0-008 0-13 77 12-12 194 33 
1917 Para A 0-07 1-12 0-000 0-03 — 2-93 139 34 
Para B 0-18 4-14 0:003 0-13 r7 3-20 346 125 
Typhoid 0-02 0-19 0-003 0-04 13-84 24-00 65 25 
1918 Рага А 0-01 0-04 0-000 — 27 — 37 6 
Para B 0-05 0-22 0-000 — | 078 | — 127 29 


9. From the same source we obtain the following figures for effects of inoculation against enteric 
fever of a regiment (17th Lancers) in Meerut : 


1907 1909 

No. inoculated — . К = : . 430 460 
No. untreated . б ‘ 5 . 220 160 
Total No. . Ў 5 : . 650 620 
Cases among inoculated . : T „ 918 18 
ditto untreated . . . . 95 96 
Deaths among inoculated : : : 1 2 
ditto ^ untreated . . - 18 18 


15.07 THE INDEPENDENCE CONDITION 


We have assumed that an f-fold sample from a universe in the context of the foregoing theorem 
signifies the same thing as f independently selected score values. Our conclusion is therefore 
that the score-sum of f independent Chi-Square variates of 1 d.f. is a Chi-Square variate of f 
degrees of freedom. A question fundamental to the rationale of the significance tests we shall 
later examine is whether we can assume that f Chi-Square variates of 1 d.f. are independent if 
their score-sum is a Chi-Square variate of f degrees of freedom. When we say that R. A. Fisher 
gave the first rigorous proof of the so-called Student distribution, this is the pivotal issue. For 
Gosset implicitly assumed that two variates of zero covariance are independent. We have seen 
that this is not so, though the converse is true, that independence implies zero covariance. To 
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say that two variates a and are strictly independent implies that the covariance of any integral 
power of a and any integral power of b is zero, i.e. for all whole number values of n and m 


Cov (a", b") = 0. 


Our models of 12.07 have shown that Cov (a, b) = 0 does not necessarily imply that this is 
so; but common sense suffices to justify the conclusion that Cov (а", Б") of 11.02, being an index 
of whether high values of a more often than otherwise correspond with high or low values of 
b, must have the same sign regardless of the numerical value of п or т, unless zero. Let us 
therefore examine the implications of deriving the result obtained in 15.04 by the method of 
moments without assuming independence. If we co assume independence we write 


E(e* . -*) = Eat). E^) = и.а) Б). 
Otherwise we must put 
E(a* . Б) = Cov (a®, b=) + E(a*) . E) 
= Coo (d, O=) + (а). pral). 
If we do not assume their independence we must therefore write the moments of the dis- 
tribution of the score-sum of two variates a and b in the form : 
pala + b) = Ба + b} 


tek 
= > к.а) 


z=0 


zak 


z-k 
= У kopala). px a(b) + z Ks, Cov (a*, №). 


z-0 
Hence, if Cov (a*, b*-*) > 0 for some value of x, there must be some value of & such that 


z-k 


pila + b) > 2 Юша). pa (b). 


Similarly, if Cov (а®, b*-*) < 0 for some value of x, there must be some value of k such that 


z-k 
pla + Б) < 2 Куша). pr- (b). 


Hence it must always be true that Cov (a*, b=") =0 | 


z-k 
pra + b) = = kia) < ша). Hx 206). 


If a and b are Chi-Square variates of m and n degrees of freedom, the expression on the right 
defines the moments of a Chi-Square distribution of (m + n) degrees of freedom. Hence the 
distribution of the sum of Chi-Square variates of m and n degrees of freedom respectively will 
be a Chi-Square variate of (m + п) degrees of freedom, if, and only if, a and b are independent, 
and we may extend this conclusion by iteration to the sum of any number of Chi-Square 
variates. 
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15.08 Tur CHI-SQUARE TABLE 


If x is a Type III variate the probability (P;) that its value will lie in the range from 0 to a is 
given by 


EE i 
p mol. ЧИА ш B é Se) 
The probability that x will be equal to or greater than a is given by 
od ipe 
eT -kz n-1 2 1H 
1—P, TG) [ ende . A * a (ii) 


When k = } and n = $f we speak of the Type III variate as Chi-Square for f degrees of freedom, 
and Elderton’s tables for a particular value of a and f cite the numerical value of the integral on 
the right of (ii). 

To obtain numerical values of (1 — P,) in (ii) we may proceed to evaluate P, as follows : 


Pe es (eae (uy — (Аа)? 
poema Rn. xn3(1 — kx + 2i 3l . etc.) 
Ce guo. 
2! ? 
ag Ге [® Ge дыме — erm. T 
T(n) Jo Г(п)і п п+ 1 200 +2) 3i(n+3) o 


‘This expression vanishes at the lower limit, and we may simplify it by putting b = ka, so that 
the right hand side becomes 
b [ jx Ab d p : p p ^ ] 
Tla ntl’ 00 2) 3(n43) atA 505)‘ 
= tae + ete) ] 
Ги) a+ yn? ' ЗІ(п + 3)” 5l(n + 5)?! р 


For the Chi-Square variate f = 2л and k = } so that a = 2, the degrees of freedom being f, 
the above becomes 


Gy 1 E 1— Заў, (Èf +9 — taf — a) 
2 dfc)" ' 2.3({/+3у® 


2) Td) 
aX&f + 25 — taf — 2a) 
+O ИЕТ; Уи ДЕШ ж} 


(iii) 
When f = 4 (Chi-Square for 4 d.f.) : 


fremd ee mes) 


Vae 82m." 2806756. - 16.D0.7.8 — 


If a — 3 in the above 
P,= 210+ A dA s 


The series involved converges rapidly, and if we take the first 3 terms only we get P, = 0:4385, 
so that (1 — P,) in (ii) has the value 0:5615. On taking 4 terms we get P, = 0-4421 and 
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(1 — P,) = 0:5579. The table gives 0-557825. ‘The error involved in rejecting all terms after 
the first 3 is in this case 0-0037 for 0-5578, i.e. less than 1 per cent. 

To use the Chi-Square tables intelligently, and especially in connexion with confidence 
ranges of variance estimates (vide 16.04), it is important to recognise the implications of the fact 
that the range of the Chi-Square variates is wholly positive. The expected, i.e. mean, value is 
given by (vii) of 15.04 by substitution of & — 3 and f — 2n, viz. : 


uy—kn-f 5 ‘i 5 А : . (iv) 


'Thus the mean value of the Chi-Square variate for f degrees of freedom is f. It may, of 
course, happen that an observed value (a) of a score distributed like the Chi-Square variate is 
less than f. We are then interested to know the probability of getting a score value as small as 
or smaller than the observed one. If so, the question we are asking is what fraction of the total 
area of the curve lies within the range from 0 to a, i.e. the value of P, in (i). Since the table 
cites the value of 1 — P,, we therefore subtract the tabular value of (1 — P,) from unity to 
obtain Р,. 

In the numerical example last cited f — 4, hence a — 3 is less than the expected value, and 
P, is the required probability. That is to say, we look up (1 — P,) = 0-557825 and derive 
P, = 0442175. 

One case calls for special comment. "The Chi-Square variate (C) for 1 d.f. is the square 
normally distributed score (c?) of unit variance. In this case the table entry for the mean value 
of Chi-Square defines the probability that the standard score will be as great as unity, i.e. that it 
will lie outside the range +ø. Similarly, the table entry against a value of Chi-Square equal to 
4 defines the probability of getting a standard score outside the range + 20. In other words, 
the values of (1 — P,) given by the table of Chi-Square for 1 d.f. refer to the modular as opposed 
to the vector likelihood (see Chapter 5, Vol. I) of the relevant occurrence. "This is what we want 
to know if the question takes the form : is B different from A? At least as often the question 
which concerns us most is whether B (the larger value) is really greater than A. If so, the sign 
of the difference is material and the appropriate likelihood is }(1 — P,), i.e. half the table entry 
for the appropriate value of Chi-Square. 


CHAPTER 16 


SIGNIFICANCE TESTS FOR ANALYSIS OF 
VARIANCE 


16.01 THe VARIANCE PROBLEM 


In Chapter 13 we explored the possible breakdown of a single sample w.r.t. particular criteria of 
classification into subsamples with a view to deciding whether variation inter se is consistent with 
the possibility of each being a set from one and the same universe. Our enquiry led us to 
formulate different estimates of the variance of the score distribution in the putative common 
universe ; and currently prescribed assessment of the credentials of the null hypothesis 
depends on the consistency of such estimates. So far we have merely asked the question : 
what statistics of such a set-up must be consistent? We have now to define the criteria of 
consistency in such a context more explicitly. 

"To say that two estimates are consistent in the most literal sense of the term means that their 
difference is zero or that their ratio is unity. When a null hypothesis postulates consistency of 
two estimates, the hitherto customary test procedure deems agreement to be satisfactory, if 
the deviation of the observed difference or the observed ratio from its mean value prescribed 
by the hypothesis is not excessive. This presupposes that we can define the distribution of 
one or the other. That of the ratio has an advantage by no means obvious at first sight. 
Since the class of significance tests we are about to examine relies on the distribution of ratios, 
a brief digression to explain it will be necessary. 

Let us suppose that A and B are two variates whose distribution involves an unknown 
parameter (K), e.g. the true variance in the case of a normal universe of which our only knowledge 
comes from two samples. It may then be possible to specify exactly the distribution of К. A 
and K.B. If the distribution of the difference (A — B) is expressible in terms of the distribu- 
tions of A and B, we can of course define the distribution of (KA — KB) = К(А — B); but 
we cannot define the distribution of (A — B) in numerical terms unless we know the value of 
K. On the other hand, it may happen that we can derive the distribution of the ratio of К.А 
to K.B; and if so, we can define the distribution of the ratio (А + B) = (K. A + К.В). 
‘Thus the derivation of the explicit distribution of a ratio may be possible in the absence of 
information necessary for defining the precise distribution of a difference. 

Such is the situation we have to deal with when our concern is the consistency of statistics 
involving sums of normally distributed square scores. We have elsewhere (14.02, 15.02) seen 
that we can define the distribution of the sum of normally distributed square scores of zero 
mean and unit variance, i.e. the ratio of square score deviations from an unknown true mean to 
an unknown true variance of the parent universe. For the reason stated, the fact that we do 
not know the true variance of the universe distribution gives rise to no difficulty if the distribution 
of their ratio rather than the distribution of their difference is what concerns us. The fact that 
we do not need to know the true mean will appear from considerations which follow. 

Suppose x, is any unit score from a normal universe, that its expected value is M and that 
the variance of the unit sample distribution is с? We then define a square standard score as 


а сос tain ui meet 
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The sum of z such scores is 


rar (x— My » 
2 о 
If each score x, is referable to an independent unit sample, we have seen (15.07) that the dis- 
tribution of such a sum is а Chi-Square variate with л degrees of freedom, i.e. that its p.d. 


equation is 
25% - 
WC лер оа E A i . (ii) 
In (i) M is an unknown parameter of the parent universe. In practice, we have only an estimate 
of it, i.e. the sample mean M, ; and the sum of square deviations based thereon is 
ron 
S бе; US ae, s SUE 
r=1 с с 


'The expression on the left is not stated іп terms of standard scores, but we can define it as 
follows : 


т=п т=п ү? rany 
=> (х Miey = — -2м у "ьм? 
r=1 ri rai” 
= S $ 3Mx.M.4M: 
r=1 7 
ah 


2 
= T — Mi + (M2 — 2M. M, + M’) 


5706—2060 +(М„— My, 


Ў (6. — M = У (х,— Му — n(M. — My, 
ÈE- M_E Мв щм,— Му, 


2 


g? с' с' 
n.V, У (х, — М): (М, – Му 
ES = = . (v) 


Now the mean of the z-fold sample from a normal universe is itself a normal variate, and the 
variance of its distribution is 


" a 
gy = —. 
n 
Whence we can write (v) in the form 
a.V, "(а — М) (M,— My f 
E 25 E = as : : E . (vi) 


In this expression the first term on the right is a Chi-Square variate of л degrees of freedom. 
Since the mean score of a random sample from a normal universe is also a normal variate, the 
second term is a square normal score of unit variance and is therefore a Chi-Square variate of 
ld.f. Thus we have expressed in (vi) the sum of л square deviations from the sample mean 
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as the difference between two Chi-Square variates. Thus the fact that we do not know the value 
of the true mean M need not trouble us, if we can formally define the distribution of the difference 
of two such Chi-Square variates. To do so, it is customary to rely on mathematical techniques 
which involve an understanding of matrix algebra and the manipulation of multiple integrals ; but 
it is possible to exhibit the argument at a more elementary level, if our approach is heuristic. 
We first explore the result of expressing (vi) in terms of normal scores of unit variance such 
as (i) above. We then put 


—M 
e = — and x,— M--c.6, 
ron ron 
"Vn. Me = > х, =пМ + У о.с„ 
r=1 r=. 


ron 

~ n(Ma—M)=0 c, 
r=1 

. M.—My [tS с, |? 

i а? B Avan 


Hence we may write (v) in the form 


RV ee т=п c, |? " 
mp PS 2— [= 5] . . . . . (vii) 
‘The two Chi-Square variates on the right of (vi) and (vii) are not independent, since the mean 


(M,) and the sum of squares are necessarily correlated ; but it will be possible to express 
the statistic on the left as a Chi-Square variate of (n — 1) degrees of freedom, if we can define a 


set of n independent normal scores (uj, ta . . . w,) of zero mean and unit variance such that 
te" с T 
m= > —. д : E . . - (viii) 
зуп 

+ +...Мм=4+а4+...а4_. Я A z x) 

n. V, = = 
t m (2 +u +13... 8)— wk = У и 2 ж 18 

т=? 


From (ix) and (ii), we see that 


тел ren 
D qms ut. 
r=1 r=1 
The sum of the squares of all the u-scores is thus a Chi-Square variate of л degrees of freedom, 
ie. that of the sum of л independent Chi-Square variates of 1 d.f.; and each square u-score 
of the sum on the right of the above is by definition a Chi-Square variate of 1 d.f. Now we 
have seen (15.07) that the sum of л Chi-Square variates of 1 d.f. is a Chi-Square variate of л d.f. 
only if the former are independent. Hence the sum of (n — 1) square u-scores on the right 
of (x) is a Chi-Square of (л — 1) degrees of freedom, if the assumption implicit in (viii) and 
(ix) is admissible, i.e. that (viii) and (ix) are consistent with the postulate that each u-score is 
a normal score of unit variance. We get a clue to the justificaiton of the postulate if we write 
(viii) in full аз: 

un i.no-pn-7i.6,pn-b.6...n-*.e, 1 i - (xi) 
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Let us consider the pattern 
u = A,.¢, + B, -ti .. Ny. 6, 5 : € . (xii) 
In the above, our c-scores are of unit variance and are independent. The variance of the dis- 
tribution of the score u, thus follows from (iii) in 14.01, viz. : 
V(u,) = А? + BR +... NR 
Hence u, is a score of unit variance if 
A+B... +N =t o. А 5 Е ‚ (xiii) 
If c, is a normal score of unit variance, A, . c, is a normal score of variance 47. Hence u, is the 
sum of n independent normal scores and is therefore itself a normal variate. Thus each of 
our u-scores is a normal score of unit variance if (xiii) holds good. 
We have now only to show that the condition defined by (ix) is consistent with (xiii). The 
next step will be easier to generalise, if we illustrate it by the case of n = 3, so that 
m= А.с + By. ca 6.65; 
us = А.с + By. cs + Cs. са; 
из = Аз. с + В.с, + Сз. Cs 


In this case 
и + uh + uf = (AE + A3 + Аа + (Bi + В? + В) + (Ci + CE + Calg 
+ 2(4,В, + А,В, + A;Bs)ey¢2 + 2(А,С, + А.С, + АзСз)ссз 
+ 2(B,C, + В,С, + B3C3)eses- 
To ensure that (ix) holds good we must simultaneously make 
(A + 43 + Аў) = (Bi + В; + В) = (Сї +CF+C3)=1 . . (xiv) 
(А,В, + А,В, + А,В) = (АС, + АС, + АС) = (В,С, + В,С, + BC) = 0. (xv) 
In accordance with (xiii) to ensure that our u-scores are normal scores of unit variance, we must 
also define them so that 


(42 + BE + Ci) = (43+ Bi + C3) = (45+ BE+C3)=1 .  « (xvi) 
In accordance with (viii), we have already defined 
At= B= 0-1 ч Е $ д А . (xvii) 


Thus three conditions only are sufficient to ensure that an n-fold set of u-scores defined by 
(xii) simultaneously satisfy (viii) and (ix), hence also (xii) : 

(a) each of the constants of one of the u-scores defined by (х) must be equal to n~? ; 

(Б) the sum of the squares of the constants in each row (A?, Br, etc.) and in each column 
(42, А2... А2, Bj, В... В,, etc.) must alike be unity ; 

(с) the total sum of cross products of corresponding constants (А,В, etc.) in any two columns 
must be zero. 

If we can choose the constants A,, B, etc. in (xii) to satisfy these three conditions simultan- 


eously, we can say that the z-fold sum of the square u-scores is equal to the n-fold sum of the 
square c-scores, i.e. that its distribution is that of a Chi-Square variate of » degrees of freedom ; 
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and if it is admissible that the sum of п Chi-Square variates of 1 d.f. is a Chi-Square variate of л 
degrees of freedom only if they are independent, we must conclude that our u-scores are inde- 
pendent variates. If so, the distribution of л — 1 of our u-scores is a Chi-Square variate of 
(n — 1) degrees of freedom, and the statistic defined by the left of (x) is itself a Chi-Square 
variate of (n — 1) degrees of freedom. 

What we have still to ask therefore is whether we can indeed choose A,, B,, etc. to satisfy 
(a)-(c) simultaneously. Тһе student who is familiar with the elementary theory of equations will 
realise that we have indeed at our disposal the requisite number of conditions to fix the con- 
stants other than A,, B,, etc. = n^*. Others may more easily grasp that this is so, if we illustrate 
the possibility of satisfying the prescribed conditions by numerical examples as in 16,02 below. 
What numerical values of the constants other than A,, Bj, C, . . . N, satisfy the conditions 
prescribed are, of course, immaterial to our purpose except to illustrate that a solution is possible. 
In choosing them, it is important to remember that no constant can be numerically greater than 
unity; but the sign need not be positive. Indeed, no solution would be possible on that 
understanding. This is consistent with our statistical requirements because the difference 
between two normal variates is a normal variate whose variance is equal to that of their sum, 
i.e. (A,c, — B,c,) is a normal variate of variance (A? + B?). 

Before proceeding we may make explicit the outcome of the foregoing reasoning. Our 
concern has been to define the distribution of the n-fold sum (Q) of standardised square deviations 
from the sample mean, i.e. 

n. bs OS s — М.) м 


р : 2 . (xviii) 
т=1 
So defined О is a Chi-Square variate Mrs = (n — 1) "d of freedom, i.e. 
#е—%9 CQUI—2) 
F(Q) = CCE ile Р ene es (xix) 


raf) 
"The statistic whose mean value is the true variance of the score distribution in the parent universe 
is as defined in 13.02 : 


ran " 
me 5, (x, —Mjgji—s-— p e 


We may speak of this statistic as the unbiased estimate of the variance in standard form. By 
definition, therefore, 
dQ 
dS, d 
Whence we may write in accordance with Case I of 15.02 
AS.) =f. F(Q); 
if 
9) „eT Se, 57-2) 
HSJ E XX 
(Se) тар (хх) 
The last equation has the same form as (viii) іп 15.05; but f = (n — 1) replaces п in the 


latter which describes the distribution of the mean value of the sum of л square deviations of 
unit variance from the true mean. 
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EXERCISE 16.01 


Note.—The following score transformations are not orthogonal, but may help the student to materialise 
some implications of such a change from one score system to another. 


1. For the Lottery Model of 11.08 (Fig. 91) evaluate the sampling distribution of ta = x, + 3x3; 
Uy, = 3x, — xs. 


2. If x, and x, are the results of the first and second toss of the double spin of a coin, determine the 
sampling distribution of S, = uz + uj, if u, and u, have the same meaning as in 1. 


3. For the 3-fold spin of a tetrahedral die with faces having 1, 2, 2, 3 pips, the first, second and 
third unit scores being ху, xs, ху, we may define a score system 


Ug = х + 3x, + 235; My = 3x, — Xa + 2x5 ; ш, = 23, — Xp — X. 
Determine the distribution of the sample score S; = u2 — uf + 2u?. 


16.02 Tur ORTHOGONAL TRANSFORMATION 


Without invoking any considerations other than those dictated by the statistical require- 
ments of the problem, we have developed in 16.01 a score transformation suggested by the 
properties of the Orthogonal Lottery Model (Fig. 97). The rationale of many significance tests 
devised during the last three decades invokes such score transformations the practicability and 
numerical meaning of which are easily demonstrable without recourse to higher mathematics. 
One step in the argument calls for clarification. The reader who is not familiar with the theory 
of equations will want assurance. We shall need л? constants A,, B,, etc. to satisfy (ix) ; and 
of these n must have the value 4, = n^! = B, etc. to satisfy (viii) and (xiii). Сап we choose 
the remaining n(n — 1) constants to satisfy (xiv)-(xvi)? Such is the theme of this section ; 
but it may be helpful to some readers who have unsuccessfully tackled a more advanced treatment 
if we first clarify the historical background of the test procedures dealt with below. 

The customary approach to the score transformation outlined in 16.01 is intelligible in the 
context of R. A. Fisher’s earliest work, published when the impact of the theory of relativity on 
experimental physics had lately provoked interest in the abstract geometry of the hypersphere. 
In this setting, there were new clues for the mathematician and new difficulties for the practical 
statistician unfamiliar with the new geometries. For at least two decades very few among those 
who espoused the techniques of Fisher were indeed equipped to evaluate their mathematical 
credentials. Fortunately, familiarity with the mathematical tools which Fisher’s school relied 
on is not essential to an understanding of the outcome, and the reader who skips the ensuing 
brief digression will not be at a disadvantage.* 

****The Geometrical Analogy. ‘The pattern for the transformation of the 2-fold sample 
of unit scores is 


У = ац. % + Ge. Xa and xf bag o5 
Уз = аза. Ху + dag Xs. 


This will be a familiar lay-out to the student who has gone far in co-ordinate geometry, being 
the usual jumping-off ground for an introduction to matrix algebra; but its interpretation 
should in any case offer no difficulty. Let us suppose that P is a point in a plane whose co- 
ordinates with respect to one Cartesian grid are x, and х. If r is its distance (the radius vector 


* Four stars mark both the beginning and the end of the passage referred to. 
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of the point) from the origin of the grid, the theorem of Pythagoras prescribes that 7? = xj + xj. 
Let us now visualise the same point in a second grid with the same origin and hence the same 
radius vector. If its co-ordinates in the latter are y, and уу, we may also write 7? = y? + 35. 
Hence a? + 42 = у? + уз. The condition (a + x3) = (y? +3) thus suffices to justify the 
geometrical interpretation of two linear equations involving 2 independent variables as a rotation 
of axes. If ais the angle the second grid makes with the first, elementary trigonometry (Fig. 117) 
suffices to show that 

Jı = COS a. x, — sina . xs; 

уз = sina. x, + cosa. x». 
If we now write а, = cos a = — аз and ау, = sin a = ay, the following identities follow : 


p = ri zz 2 1 
аё +а&=1=аф-+а& and а +-а = 1= а-а . А (i) 
(since sin? a + cos? a = 1). 


ау. ау» + аа. аз» = 0 = Ay. Ay + 435. Ae 3 : 3 (ii) 


ROTATION OF AXES IN A PLANE 
ee 
exi 
Ру), ET ix, xercos b 
= ersinb 


Yen 
у=г соз(а4) г, 
yr sin(a+b) 


Since cos(o«b):cos o.cos b-sin a.sinb and sin(arb)=sin a.cos b+cos a.sin b 
y,= cos a.cosb —rsina.sinb = COS Q.2c, - sina. x2 
y,"r sina.cos b + r cos a.sinb = sina. x, + cos a.x, 


Fic. 117. Geometrical meaning of the Orthogonal Transformation. 


If a = 45°, cosa 7. = sina and y= aunt ve n= z- Je 
If we interpret our score transformation in terms of the rotation of axes, we thus see that : 
(a) each horizontal and each vertical sum of the squares of the coefficients is equal to unity ; 
(b) the sum of all the vertical cross products and of all the horizontal cross products is zero. 

"Тһе reader who has an elementary knowledge of co-ordinate geometry in 3-dimensions will 
be able to take the argument a step further. If P is a point in 3-dimensional space with co- 
ordinates ху, Xs, x, the equation which defines its radius vector (r) is xj + х3 +a3= 7°. If, 
therefore, у, у», ys are its co-ordinates in another framework with the same origin, 


bete roses 
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We may then specify the relation between the co-ordinates in the form : 
Yı = dg Ху + з. Xa + dis X8; 
Уз = аы. + dog Xa + азз. х3; 
Уз = аз. Ху + Age Xo F йз. Хз. 
By elementary trigonometry, we may derive relations similar to those of (i) and (ii) above. 

In 11.07 we have metaphorically spoken of super-solid figurate numbers, the build-up of 
which follows the same lines as the corresponding picturable number scores for 0, 1, 2 and 3 
dimensions. In the same way, there is no objection to the use of the term radius vector to define 
а sum of squares such as 7? = (xf + a + x3 + 3$), and we may speak metaphorically of ху, ху, 
etc. as co-ordinates of a point in a 4-dimensional ultra-visual grid. If r? = (5? + 5$ + 93 + y4) 
we may likewise speak of уу, Ya etc. as co-ordinates of the same point in a 4-dimensional grid 
with the same origin, and define a 4-fold system of linear equations descriptive of rotation of 
axes in a so-called 4-dimensional space. Actually, we are here using the idiom of geometry to 
describe algebraic manipulations which we can no longer picture. Whether it is helpful or 
otherwise to do so depends entirely on whether it is a familiar idiom. If so, an excursion into 
the hypersphere may help us to discover new or to interpret known relations. Otherwise, the 
safe course is to keep our feet on the solid ground of algebra, as we shall now do. In any case, 
we have to rely on matrix algebra to generalise the rules which we shall now examine in greater 
detail. 

Rules of the Transformation. As a general pattern of the so-called orthogonal transformation, 
it will suffice to lay out a 4-fold set of duplicate scores u, and x, : 


шщ = Ах, + Byry + Cy, + Руха 5 
ug = Азх, + Boxy + Coxe + Юха} 
Us = Agr, + Byty + Cove + Юха; 
и, = Agha + Bax, + Cate + Dire 
We speak of this system as an orthogonal transformation if 
ud + ud + ug + ug = x2 + xf + А2 + х5. 
If this relation holds good, 4 rules subsume the relations between the linear constants А,, B,, etc. 
They are as follows : 
Rule of Column Squares. The sum of the squares of the constants associated with each 
x-score is unity, which we write for x, when there are 4 independent variables as 
r=4 
> Nia 
r-1 


Rule of Column Cross Products. The sum of the products of the constants associated with 
any single pair of x-scores in the same row is zero, which we may write for x, and Xm when there 
are 4 independent variables as 

?-4 
> NM, — 0. 
r=1 

Rule of Row Squares. The sum of the squares of the linear constants definitive of a single 
u-score is unity, i.e. for и, of a 4-fold set 


А? + B24 С? + 12 = 1. 
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Rule of Row Cross Products. The sum of the products of all pairs of constants definitive of 
a single pair of u-scores is zero, i.e. for the 4-fold set 
4,4, + B,B, + C,C, + D,D, = 0. 
For a system of more than 3 equations the derivation of the rules is very laborious without 


recourse to determinants ; but the student can easily verify them for the 3-fold set if we here 
give an elementary demonstration for the simplest case, viz. : 


u, = Ах, + By; и. = Agta + Boxy and uj + ug = х2 + 4}. 
The rules then take the form : 
Column Squares and Cross Products. 
Ai + А = 1= B} + BE and A,B,+ А,В, = 0. 
Row Squares and Row Cross Products. 
Aj + В = 1 = AP- BP and A,A,+ B,B,=0. 
The derivation is as follows. If uj + u$ = x; + xj, 
(A3 + A3) + (BE + Bist + 2B, + А,В), х, = a8 + nd. 
Hence by equating coefficients we derive the column rules of (i) above : 
Af + A}=1= B} + В}; 
A,B, + А,В, = 0. 
We now express each x as the dependent variable by solving the foregoing equations. "Thus: 
Ази, = AA x, + А»В,ль; 
Аш» = А,А»х„ + Ban, 
En A 
A,B,— AB, A,B, — AB, 


ey «Up. 


Similarly 
В, B, 
^ 7B, — ABS AB,- ABS 
If (A,B, — A.B) = D, we then have 
Xa = B,.D.u, — B,.D.u; 
x, = — A.D. + 4,.D.u; 
Whence the relation (x2 + 32) = (ui + u3) means that 
(43 + B$)D* . ut + (At + ВР". ug — 2(4,4, + B,B,)D* . щиз = uj + ш, 
4+ В = D?= A? + Bi; 
А,А, + B,B, = 0. 
The last equation corresponds to the rule of row cross products. We obtain the rule of row 
squares as follows : 
Since (Aj + 45) = 1 = (Bi + Bj), 
2D* = (Aj + A$ + By + Be) = 2. 


Whence D = 1 and 
42 + В? = 1 = A} + Bi. 
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"The rule of row cross-products has a special statistical meaning, because it defines a necessary condition 
of the statistical independence of the u-scores. The reader who is familiar with determinants may 
generalise the argument which the following illustrates. We suppose that we have a 3-fold sample, 
and postulate 

ty = 44.64 By. + 0.6; 


и, = Ay. & + By. e+ Cy. 65; 
Uy = Ay. & + В.с + Сз. сз. 
The cross-product rule for the rows is 
4,4, + B,B, + C,C, =0; 
A,A; + ВВ, + СС, = 0; 
434, + В.В, + CC; = 0. 
If our u-scores are independent, their covariance is zero. Now both u-scores and c-scores are 
scores with zero mean value, so that 
Cov (ш, и.) = E(u . и,) and Соо (с, сз) = Ё(су. es), ес, 
у. Cov (uy, иу) = ЕА, + Bica + Сүс;)(Азс + Bata + Cres) 
= 4,4; . Е(дї) + B,B, . Е(е) + С.С. Е(‹$) + (А,В, + А,В). Е(су. сз) 
+ (A, C; + АС). Е(су. с) + (В,С, + В.С). Ес. с). 


In these expressions E(cj) = 1, because the c-scores are scores of unit variances and E(cp . са) = 0 in 
virtue of their independence, so that 


4,4, + В.В, + C,C, = 0.**** 
Numerical Illustrations of the u-score transformation. In 16.01 we defined 3 conditions as 
sufficient to ensure that the sum of the squares of an n-fold set of u-scores each defined in 


terms of n unit sample standard scores (c,) by (xii) is a Chi-Square variate of n degrees of 
freedom. The general equation for the eu-score is 


u, = Ас, + Вс, + С,.с,. . Ele 
The three conditions are : 
(i) each of the constants Aj, B;, C, etc. referable to the specification of u has the value тї; 
(ii) the sum of the squares of the constants in each row (47, Bj, C7, etc.) and of the 
constants in each column (e.g. Aj, 43, Aj . . . 45) is unity ; 
(iii) the total sum of the cross product of corresponding constants in any two columns 
(A,B,, А,В,, etc.) must be zero. 


We shall now illustrate the possibility of choosing the constants accordingly by recourse 
to numerical examples. 


Case I. Two Variables. Our equations are 
m= А.с + Bı. cs; 
и, = А,.с + Bz. Co 
To make the coefficients of и, equal to »*, in which event А? + Bj = 1, we put 
Hi yr T Wu 3 
u, = А,.с + В.с. 


SIGNIFICANCE TESTS FOR ANALYSIS OF VARIANCE 679 


To make А2 + Bi = 1 and 42 + 42— 1 = B} + B}, A, = + (4) and B, = + (8); and 
the column cross products will vanish if the signs are opposite, when row cross products also 
vanish. Thus alternative solutions are 


eee bk 1 1 
4p = уға үа; ш = ута уба; 
1 309 1 1 
a= fe vaca) Us Уз Т vagos 


Case II. Three Variables. We define the constants of the first row to satisfy Rule (i) 
above, and fix one constant in each remaining row and one other in each column to satisfy Rule 
(i). Our equations are then 

== Feat vtt уд} 
и», = 45.6 + By. ca + (1 — AZ — В8)іс, ; 
Е @ — А # + ($ — Вс, + (48 + Bi — Pes 
We may satisfy the condition that the cross products of the first two and of the first and the third 


column vanish by evaluating B., having fixed A, arbitrarily. We shall put A, = 0, so that the 
system of constants becomes 


из = 


m 


TX T0: (3) 
0 B, + (1 — B» 
@* @— В} +(— $). 


The cross products of the first and second columns vanish when 
GPG- BI = -4 
"В, = + (y. 
We have now the set 
TG TG +0); 
0 EXC + (0; 
+ ($) + (3) + (8). 


It remains to choose the signs so that all the cross products of the columns vanish, viz. : 


TG + + (8); 


П 


0 — (bt TG. 
(3) —@ — (9. 
Our final set of equations is then 
ty = Jg + уа + vss) 
— 
u =a — S vate 


Again the cross products of any two rows vanish, 


(4,4, + B,B, + C,C;) = 0 = (A,A, + ВВ, + C)C5) = (AAs + B3B; + С.С). 
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Another solution which likewise satisfies the prescribed conditions is 
+ (3) + (3 TG 
TQ — @)* 0 
+) + @* — G. 
Case III. Four Variables. In this case n~* = $, and we may write down our system of 
constants as 


i i i i 
А, B, C; + (1 — Az — В: — C» 
A, B, C, + (1 — Aj — B$ — C$} 


-à—41—45* -($—Bi-B)! -($—Ci-C)* x (4irÁAP-BE-Bi-CH-C$— 1). 


We may now fix any 3 constants in the first 2 columns without prejudice to the condition 
that cross products with other columns must vanish. We shall write A, = 0 = В, = B;; 
and our system takes the form 


i i + i 
0 0 с, а — cot 
А, 0 C; (1— Aj — Cb 


:ü—-4» xd! +@—-с—-су (48+ 6:46: — 9). 
To satisfy the condition that cross products of the first two columns vanish 
3 — 40 = (— 3° 
~ A= G. 
The sign of А, is immaterial but ($ — 4$) and (3) in the bottom row must have opposite signs, 
and we may put 


i i i i 

0 0 C, (1 — C3} 
TO 9 Cs @— су 
+ (yt -G z-ci-c» (Сї + Ci— Ys. 


We now fix C, and C; so that the cross products of the first and third and of the second and third 
columns vanish. By taking the third with the second we get 


4@— с — С) = 15 
= @— С — СЗ) = + Gp. 
Without prejudice we may fix the sign of the above, and obtain from the first and third columns 
+ + (DC + 1 =0 
+ C= GY. 
Whence from the foregoing expression for ($ — C$ — C$)* 


ve — Сё = үу and C,— + (B. 
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We thus have the system 


+ + i i 


0 0 + Ф) + CAU 
(8+ 0 = @)* +(@ 
(Ср) eye (re + y. 


We can now fix the signs to ensure that the cross products of the first and last and the second and 
last columns vanish, and the only arrangement which then makes the cross products of the third 
and last vanish also is 

i i i i 


0 0 à» -G 
coy 0 — @) Sate 
(rod 520) Gh Gh) 


Again the cross product sum of any two rows vanishes in accordance with zero covariance. 
Another solution which is likewise consistent with the prescribed conditions is 


m=, cie cde +4 


ENS 23 асел 
а= Vet ув 


1 1 
“= уз — ува 


m=fa с. — без — Фа. 


1603 CONFIDENCE LIMITS OF VARIANCE ESTIMATES 


In Chapter 13 two issues involving significance of variance estimates emerged. One dealt 
with in 16.07 below involves the consistency of two such estimates, when the end in view is 
to test the null hypothesis that the universe of choice is homogeneous w.r.t. the criteria of 
classification. The other arises in connexion with the construction of a balance sheet exhibiting 
components of variance, if we reject the null hypothesis. We may then wish to set limits of 
confidence to the items in our balance sheet. 

Tf we can assume that the distribution of all our score components is approximately normal, 
we can regard each estimate (V,) as a Gamma variate, which we can express in Chi-Square form 
by the substitution 


n.V, n.V, 
EX === so that o° = 5 ` 


As shown in 16.01, the distribution of S is that of Chi-Square for f degrees of freedom if 
f = (n — 1) for an n-fold set of normally distributed score values. In (i) above V,is the mean 
square deviation from the sample mean. Alternatively, we may express S in terms of the un- 
biased estimate (s?) of the sample variance by recourse to the identity 


(i) 


V. 


n—1 


PUES ir 
o E : Е . : - „ч Pin) 
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By recourse to the table of the Chi-Square integral for the appropriate value of f, we can 
use (ii) to define confidence limits of the true variance in terms of the unbiased estimate. The 
procedure is as follows. Let us denote by 5 = a and 5 = b respectively the values of the Chi- 
Square integral which makes the total area under the curve equal to P, and P, i.e. 


[| (5)48 = P, and f KSAS = P, 


E [sus = Р,— Р, > еб eee TRY 


In this expression (P, — P,) defines the probability that the values of S will not be outside the 
range from a to b. Alternatively, we may say that a and b respectively define lower and upper 
limits to a range of 5 (Chi-Square) values whose net expectation is P, — P,. From tables of 
the Chi-Square integral we may at once evaluate (iii) for the assigned values of 5 definitive of 
a range whose expectation is 95 per cent., as when Р, = 0-025 and Р, = 0-975. The tables of 
Chi-Square for 9 d.f. cite a score value a = 2-7 for P, œ 0-025 and a score value b = 19 for 
Р, => 0:975. Thus 27 and 19 define а range of 5 values whose total expectation is approxi- 
mately 95 per cent. and the odds are therefore 20 : 1 that a value of S will neither exceed 19 nor 
fall short of 2-7. 

From (ii) above, the assertion that S lies between the limits a and В inclusive is equivalent 
to the assertion that the true variance с? lies in the range from 


X £ 


a= rà to о = P * . . . . nv) 
Both assertions are true of 95 per cent. of samples, if we choose appropriate values of a and b as 
indicated above. Thus our risk of error will be 5 per cent. if we consistently apply the rule 
implicit in (iv) to assert a range of values within which o? lies. For example, we may suppose 
that our unbiased estimate of variance (s?) referable to a 10-fold sample is 12, in which case 
f = 9 as before. We then have 


9 9 
2 сы — (12) e c ~(12)~ 54 
оа = 5 (12) => 40 and oœ 19012) 2568. 


We аге thus entitled to say that the odds are about 20:1 that we shall not err in asserting 
the true value of the variance of which our unbiased estimate is 12 to be within the range 
5:68 — 40. 

The asymmetry of this result arises from the skewness of the Chi-Square distribution. 
The foregoing argument involves the assumption that our sample variances are referable to 
normally distributed score values. This may or may not be a legitimate assumption, if we base 
our balance sheet on the postulates of Model IT in 13.04 but it cannot be legitimate if we adopt 
the Model I viewpoint. 


16.04 DEGREES OF FREEDOM FOR VARIANCE ESTIMATES 


In Chapter 13 we have derived unbiased estimates of the variance of the rc-fold sample 
score distribution of a homogeneous normal universe classified w.r.t. two criteria and of the 
nrc-fold sample score distribution referable to three criteria of classification. We shall now 
see that the corresponding standardised sums of square deviations are in each case Chi-Square 
variates, and the divisor of each sum of squares is the appropriate number of degrees of freedom. 
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It will suffice to consider the statistics s? and s? for a set-up involving 2 criteria of classification 
as in 13.03 and 13.04. If M, is a column mean and M, is the grand mean of the sample, we 
define s by the relation 


. 0 


If o? is the true variance of the score distribution, that of the mean of the r-fold column sample is 
given by 
g=- . 5 7 E 5 5 A 


Whence we have 


oo ——Á— MO „ ee Ш) 


We shall write S; = (c — 1)s2, so that 
S, _ (М, — М.) 


© A та ш) 
If M is the true mean score, we may write as in 16.01 
S, М, My М. My б) 
о т 9 % 
In this expression, we have 
i-e M, 
M,—2— 7 > а 5 > a (Ww 
i-a € 


Thus M, is the mean of a c-fold sample of column mean scores. Hence the variance of the 
distribution of M, is given by 


2 _% 

9: = —, 

с 
2S, T му (М. My 3 
Ducum a a (vii) 


If the score distribution is normal, that of the mean is also normal. Hence we have now ex- 
pressed (iv) as the difference between a c-fold sum of square normal scores of unit variance and 
one square normal score of unit variance, i.e. as the difference between a Chi-Square variate of 
с degrees of freedom and a Chi-Square variate of 1 degree of freedom like the expression defined 
by (vi) of 16.01. In (vii) above M, is the mean of M; as М, is the mean of M; in (viii). Thus 
the two expressions are in all respects comparable. It is therefore unnecessary to repeat with 
appropriate change of symbols the orthogonal transformation of 16.01 in order to show that 
(S, + о?) is a Chi-Square variate of с — 1 degrees of freedom. 
Mutatis mutandis the same argument applies to the statistic 


(rosse (Муму . «a, 00 
j71 


In this case (S; + o?) is a Chi-Square variate of (r — 1) degrees of freedom. 
9 * 
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"The total sample variance yields an unbiased estimate of the same form as (v) and (vi) 
in 16.01 based on re-scores. We may write it as 


i-ejer 


(rc — 1); = S; x 23 (к,— M) . . . » & 
i=1 j=1 
As in the derivation of (v) we obtain 
Sis_ Si (ea — Му r(M.— My 
= : т = i 
о? 2, 2, gt o? 
Since M, is the mean of an rc-fold sample, the variance of its distribution is given by 
aot 
=» 
‚ Su «(х= Му (M.— My (xi) 
DEUS т то СА h 


It is thus evident that S;; in standard form is a Chi-Square variate of (rc — 1) d.f. 

‘That the numerator of the estimate s? of 13.03 and 13.04 is also in standard form a Chi- 
Square variate with (r — 1)(c — 1) degrees of freedom is less easy to see, and calls for closer 
examination. We define it by the relations 


ung) a м 
КЕ Xe 
M(V,) + MV.) — Е. = V, = V,— V(M,) — V(M,). 
We may write the preceding expression more fully in standard form as 
fc. V, Boi se — My se (M; — М,)? x5 (M,— M 


а? i-1j-1 а? j=l а? i=l о? 


We may transform this as above to 4 sets of square normal scores of unit variance, viz. : 


(r—1(c—1), т. И. tiet (xu— My (M.— My 
о д о? à p о n о 
i(M,—My (М, – My Р 
. (xii 
2. о 2, o ш) 
It will be more easy to follow the appropriate orthogonal transformation, if we drop the 


subscript symbolism, and deal with the procedure. Accordingly, we assume the following 
schema of independent normal score values : 


Scores Mean 

X, X Xs х, Mi., 

Scores РА zs РА =. M... 
х, *10 Xn Xa Ms., 
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For this assemblage we may write the first term of the expression on the right of (xii) in 
the form 


S S cO = M EM 4 Ao s idi 


v s 


i=1j=1 M s=1 a=1 
By definition 
a-12 a=12 
12M,= > x, and 12(M.— M)— У (х, — M), 
e=1 s=1 
12(M, — M) S 
Se Cy 


um 2-1 


Since o = У120, 
M—M. 1 г? 


v = Via 2, ©; Э б ü . (xiv) 


We shall now assume that it is possible to transform the c-scores into u-scores in accordance 
with the orthogonal relation 


s-12 -12 
руы >а 5 : = à ч . (ху) 


In virtue of (xiv), we are then free to define 


M,—M 15.53 А 
е а о DI . (xvi) 
Hence we have the following expression for the first two terms on the right hand side 
of (xii) : 


bd S Gn — My + (M,— M} out | = 


2 e 
ur z . (xvii 
j=1 i= о oz E 4 ) 


2 
We shall now write in the term of (xii) involving е row means 


(№. —M) y, (М.М), (М.М) 


= = smog (әй) 
Similarly, for the term involving the column means we shall put 
MM (M M), 
с. oe 
ha M aou M Luc C o. vp) 


Te с, 
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Hence the last two terms in (xii) become 


j=r М, 3А 2 a 
Pe qeded. 2... 
— M,— P 2 2 E 
SOL MY aputai o 0.00.0 0. Gu) 
En с 
The v- and w-scores so defined are linear functions of the c-scores. For instance, 
= M) , (х — M) , (x — М), (xi — M) 
M,.,—M oe eae ng ! T? 
Mi., 
. E = а + e + ca + су). 
Since V4e, — c 
M,.,—M fe 
= Flateatata)=n . . . oa (xxi) 


о, 
Similarly, we have 
me zs +e tct c) end оз = vio + Go + ĉn + аз), 
2-12 


^" 9; 92b v = z x Cn 
бе 


2-12 


Jla + o +o) = упт 2, = (xn) 


In the same way we derive 


w Fats Fe); w Fleta со) ; 


о = vals Hatin); w= vs Toca) . . - (xxiv) 
E vg + Ww + 203 + 204) — щш. : - E = . (xxv) 


Thus our v-scores and w-scores are each expressible as linear functions of c-scores, as are our 
u-scores by definition. It follows that the v-scores and w-scores are linear functions of the 
latter; and we may assume the orthogonal relations 


vi + oF + 05 = ub ou us 
Bi. 
j=r i-e 1-6 
^ $e m (EO. M 2u? + zu Е T ‚ (xxvi) 
E т = бег 


By substitution from (xvii) and (xxvi) in (xii) we have 


(r — 1)(с — 1) 
p м 


2 2 2 2 2 
и + иң + иў + tio + uj + tiie 
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This expression involves 6 = 2.3 = (r — 1)(с — 1) square u-scores, ie. (r — 1)(с — 1) in- 
dependent Chi-Square variates of 1 d.t. The general pattern of the transformation is as follows : 


E 23. = 7с з= т з= е1 
e = D; S и + ut E t zt 5 a] 


з=1 s=r+1 


s=re s=rte-1 


=з 1-2 


The last expression contains rc — (r + c) + 1 = (r — 1)(с — 1) terms. 

At this point, the reader may reasonably want assurance that the simultaneous transformation 
of (r + c — 1) of the u-scores into v-scores and w-scores in the foregoing is consistent with the 
orthogonal relation between the entire rc-fold set-up of u-scores and c-scores. In accordance 
with results obtained in 16.02, the following arbitrary constants satisfy the v and v score trans- 
formations : 

1 1 1 
Wy = gti 750: уа; 


us = gti — 3s "OC 
uy = vg +у „о ; 

* * * * * * * * 
m= {ш + fw +40, odes 
My = gr — gM - + 5 
tig ACIE Viv" 


tig = {ш + dw.— dw. — de. 


It will suffice to examine the orthogonal property of the pair из and и, so defined when we 
express them in terms of the c-scores. From (xxii) and (xxv), we have 


из = gg (n + сз + са + cat ts а + о а) — Felco + co + Gn + аз); 


us = ag lea + Ca + 6s + % + 6 + си) Vig( + @ + 6r + Ca t+ си + бы). 


Evidently the sum of the squares of the constants in each row is unity and the sum of the cross 
products vanishes as we see if we set them out as below : 

e сз єз с, % % с Cs с Cio ei Суз 
u 1 1 1 1 1 1 1 1 -1 i -1 =i 
з 34 wv34 v24 уза v234 уза уза уза VE VE VE VE 


" 2) 1 -1 -1 1 1 -1 E 1 1 -1  -1 
* 12 v13 Viz Viz Viz Viz Viz Viz Viz Viz Viz viz 


For this set-up we can thus define 6 u-scores as linear functions of the c-scores in conformity 
with the rules : (а) that the sum of the cross products vanishes for any pair of rows ; (b) that the 
sum of the squares of the constants in any one row is unity. It remains to define 6 u-scores 
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involving 12 x 6 — 72 linear constants of which the orthogonal relation for the square constants 
in columns and rows fix the 12 of the last row and the last member of the 5 remaining rows, i.e. 
17 inall. We can fix 55 remaining constants arbitrarily to satisfy the condition that the sum 
of the products of corresponding constants in any pair of columns vanishes.* 

In (vi) of 16.01, we have eliminated the negative term by putting 


1252-6 6-5) 


This procedure depends on the fact that the statistics under consideration so far involve equal 
numbers of scores in each column or row. Ina set-up involving only one criterion of classifica- 
tion as іп 13.07, we may have different numbers (r;) of items in different columns, and it is 
necessary to modify the foregoing procedure. Let us first consider the statistic defined by 
(viii) of 13.07, viz. : 

i-e 


а SUM 


p= 
c— 1, 


* [n more general terms the schema of the double transformation is as follows : 


M t=ej=ar mem 
иа У >= >= 5.5.0 
i=l j=1 т = 1 
i=oj=r 
м„-м_ 1 " 
E cum ENS ЭШИ 0 
ime jar З= 
M,—M 1 1 1 T 
-9,-—- си and —- y= >= =u . > . (ii) 
a P ur PX CCo 
j=r m=r 
2dg-2wu. . . . . . . EI 
j=l m=1 
M,-M 1d 1 бг 1 toe dar 
eyo d > == mu г 
Рыа PL 00 
= с merte-l 
> a+ Ropers cD 
i=l m=r+1 
i=cj=r jer ime 
У > с-м)» У(м-м" È -M 
i=lj=l коему j=1 i=l 
“ оа о % 
mere m-r m=r+e—1 
= > u +u У 4-d- ty 
m-1 m-1 m-rtl 
mere m=r+e—1 
far > ai — 2, 
m= m=1 
nar 
= У a, with (re —r —c + 1) = (r — 1)(c — 1) terms. 
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When there are two columns (c — 1) — 1; and we shall now see that the ratio of s? to the true 
variance of the score distribution is a Chi-Square variate for 1 d.f. If we put 7, = a, 72 = b 
and (a + b) = n, we may then write 


2 a(M,— M.) , ҚМ, — M;y 
t 


E F = . (xxvii) 
In this expression the sample mean is given by 
Mee се "erre 


Whence we have 
a(M, — M.) + KM, — M; = a. M3-+ b. Mẹ + nM? —2M,(a.M, + b. My) 
=a. M; 4 b. Mj + nM — 2nM;, 
^. a(M, — M.) + (M, — Mj =a. M2 +b. MẸ — n.M? . : u . (xxix) 
If the unknown true mean score is M, we may put 
a(M, — My + (M, — M} = a. M2 + b. M? — 2M(a . M, + b . My) + nM? 
= a. Mz + b. Må 2nM . M, + nM* 
= (a. М2 + b. Mẹ — nM3) + (nM; — 2nM . M, + nM?). 
Whence from (xxix) 
a(M, — My + (M, — My = a(M, — M; + (M, — М.) + (M, — My, 
-. (M, — M,)? + (M, — М.) = a(M, — My + (M, — My — (M. — My, 
S «MM» щм,-му_щм.—му _ 
oi E E с? 


If we denote the variances of the distributions of the column means by о? and of and that of ће 
grand mean by oz, we have 


+ (xxx) 


2-00 = а = 0.00 = но). 3 ; С ‚ (xxxi) 
Each of the three terms on the right of (ххх) is thus a square score of unit variance, viz. : 
$ (M,—My,(M,-My (M.—My 
et on alee o 5, 
We shall now assume that the score distribution is normal whence those of ће column sample 


means and that of the grand mean are normal, so we may write in the usual way as square standard 
normal scores 


(xxii) 


ee dl Te a nila a 


ae E 
In the third term of (xxxii), we note that 
n(M, — M) — a. M, + b. M, — nM = a(M, — M) + (M, — M), 
QI — М) «M,— M) | KM, — M) 


Oz no. no, 
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From (xxxi) we have 
айс, = nto, = bay, 


4 A M. eee. (PAM, 0 


Oz oq 


= (©). + (s d М ; 5 8 (хххіу) 
"ER 
v= (Yeu — (2. 


"The variance of the v-scores so defined is unity, since (а + b) = n and they constitute а pair of 
normal standard scores. Also it is evident that 


We may now put 


(M, — My 
n 
01 a 
Whence from (xxxii) and (xxxiii) 
$-qrd-4d-d А A n А . (xxxv) 


"Thus the statistic on the right is a square normal standard score, i.e. a Chi-Square variate of 


1d.f. 
Let us now consider the residual statistic s3 of (viii) in 13.07. For the two-column set-up 


we defined it as 


p Jae 1 ize 
D т=з Ma) +50, ы My, 


(xxxvi) 


Se —24 ders M) sers — MY 


2 э 
[ Jei СА fai о? 


We may assume that the column samples are independent, and the expression оп the right is 
therefore made up of two independent Chi-Square variates of (a — 1) and (b — 1) degrees of 
freedom respectively. Hence the distribution of their sum is that of a Chi-Square variate of 
(a — 1) + (b — 1) = (n — 2) degrees of freedom. 

For a table of more than two columns with an equal number (7) of score values in each, we 
may define as a Chi-Square variate of c(r — 1) degrees of freedom 


(xxxvii) 


= Ds ae = P (x — кс 


In terms of the parameters of the score-grid 


n 
ga 
d mam 
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When our concern is with only one criterion of classification, the numbers of items (7;) in each 
column need not be the same, and if л is the total number of cell entries, i.e. n = rc in the above, 


(n—o$ "S — M} 
E UY CEN 


n—c 


s= M(V.) and (xxxviii) 


i-1j-1 


16.05 Tur PAIRED DIFFERENCE TEST FOR SMALL SAMPLES 


In Chapter 7 of Vol. I we have distinguished between two ways of investigating a real 
difference in the domain of representative scoring : 


(a) comparison of the mean scores of groups subjected to different treatments as in 16.06 
below ; 

(b) comparison of response of one and the same individual before and after treatment or 
of the effect of different treatments on pairs of individuals the two members of which 
share a common peculiarity. 


The second procedure involves the null hypothesis that the true mean difference between 
paired scores is zero ; and we can test its validity if entitled to assume that the d-score (i.e. paired 
score difference) distribution is normal, as it will be if we regard each pair of observations as a 
2-fold sample from a normal universe. On that assumption, we can safely apply the c-test for 
a normally distributed score, if the sample is large. If Mz is the mean difference and s; is an 
unbiased estimate of the true variance c; of its distribution, the appropriate ratio for a p-fold 
sample of paired scores is as given by (xix) in 14.08 : 


Lt 2 
(24) a 
d-m— = . T s , ` x i) 
а 


т=1 


In view of what follows, it is important to stress that 52 is an unbiased estimate of o2, as 
defined by the relations implicit in the above, viz. : 
2 1’S = 
E,(s2) =02 and $=- 2,4; 5 В E me OH) 
p 
If M is the true mean and oj is the unknown true variance of the d-score distribution, we may 
write in the symbolism of 13.02 : 


E,. E,(d, — М)? = oj = E,. E,(d?) — М. 
In this case, the null hypothesis implies that M — 0, 
^ E, E4) = oj, 


1 оё 
x Tp, E (di) =! — o£. 
QU ms 


In the preceding expression 


12Р 
Ed) =}. dr. 
Prai 
Whence as in (ii) : 
Es) = оу 
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The exact c-ratio (M ; + ¢,,) corresponding to (i) is a normal variate of unit variance. Unless 
the null hypothesis—as in Mendel's laws—prescribes a priori values both of the true mean (in 
this case, zero) and of the true variance (о2) of its distribution (here, unknown), the c-test for 
paired differences is inexact in the sense that an unbiased estimate (52) of the universe parameter 
оу, replaces the latter as in the denominator of (i) above. ‘The empirical critical ratio so defined is 
therefore subject to sampling error; and its distribution is indeed determinable when the parent 
universe is itself homogeneous and normal. Vis-à-vis the significance of paired differences, this 
limits its usefulness to situations in which we can legitimately postulate a homogeneous dis- 
tribution of d-scores. As indicated in 14.08 a d-score distribution is homogeneous, if and only 
if, we can regard each pair as a 2-fold sample from a sub-universe with the same sampling 
variance as any other such sub-universe. 

In what follows our immediate concern is with the distribution of an empirical ratio for the 
mean score of samples from a homogeneous normal universe ; and its relevance to the problem 
of paired differences (d-scores) is one which we shall examine more fully in 16.07 below. We 
shall therefore denote by M, the mean of an n-fold sample of unit scores (x,), and make no 
assumption concerning the numerical value of the true mean (M) of the parent universe of 
x-scores. Accordingly, we define our unbiased estimate of the variance of the n-fold sample 
distribution in the usual way as 

т=п ——. 2 
E(sj)-o* and "= У ана 


r-1 


(iii) 


Our unbiased estimate of the variance of the distribution of the sample mean (М,) will 
therefore be 
r=" (x,— M 


y.- 


We may thus define an empirical ratio (t) by the relation 


Ree Ou tT D qme LU 
2 M, о 2 т=п  — M; 2 

И ES * o? ы 2 о? ! ч б) 
(M,— My ets — Ma} 
on ү 2, о? ў 


In the foregoing expression the numerator із а true square standard score, i.e. a Chi-Square 
variate of 1 d.f. The denominator is a Chi-Square variate of (n — 1) = f degrees of freedom, 
since we can write it as 


FM «M. My Cet My (Ma My 
r=1 а? о? ES r=1 о? om ; 

"This has the same form as (vi) in 16.01, and if we apply the appropriate orthogonal transformation, 
we have 

uy 


SZF... и 


ad% 
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In the above our u-scores are by definition independent, and we have eliminated uj from the 
denominator. Hence the numerator and denominator are independent statistics, і.е. (t + f) 
is the ratio of a Chi-Square variate of 1 d.f. to an independent Chi-Square variate of f degrees of 
freedom. 
Now we have seen in 15.04 that if x is the ratio of a Chi-Square variate of 1 d.f. to an in- 
dependent Chi-Square variate of f degrees of freedom, its p.d. is 
xmi 


1 
Дх) = Bü. i) О) 
In this case x = (t? +f) and the simple scalar substitution of Case I in 15.03 yields 


F(t) 


to 


Bi, ae (1 " ғ)" D 


(vi) 


The derivation of the p.d. of ż itself in accordance with Case IV of 15.03 presupposes an 
ulterior reason for believing that f(t) is a symmetrical function of t. The latter is the ratio of the 
deviation of the sample mean from the true mean to the square root of the sample estimate of its 
variance; and the distribution of this ratio is necessarily symmetrical if the distribution of 
score deviations in the parent universe is itself symmetrical. This is easy to see of the discrete 
universe and hence of a hypothetical continuous universe in the limit. For a given numerical 
positive value of the score-sum or mean (M) we may pair off every uniquely constituted 
combination of unit scores with an otherwise identical set of reverse sign, their mean (— M) 
being numerically equivalent to M but negative. 

One illustration which the reader may explore more fully should suffice to make this clear, 
viz. extraction of 3-fold samples from a 7-class rectangular universe of score deviations — 3, 
—2, — 1, 0, +1, +2, +3. We need only consider score-sums of + З with mean value 
+ 1. All corresponding combinations of unit scores consistent with these values are then 


Е) ВОО ШЕ ЕЗ0 0006 

od DEM UN ТИТ ЕТТЕ: 
Ae =38,0у0.... аа a Gy «eiae 

Dene ere Daa TEE do] 


Thus corresponding sample values of + M and — M will have equal frequency if corresponding 
negative and positive values of the unit scores (x,) have equal frequency; and sample 
variances corresponding to each pair of numerically identical scores of reverse sign will be 
necessarily identical, and will not affect the ratio of (М, — М) to Sm. The distribution of 
the ratio therefore depends only on the distribution of М, ; and this is necessarily symmetrical, 
if the distribution of x-scores in the parent universe is symmetrical, as is true of the normal 
universe we postulate in this context. 
As in Example 5 of 15.03, we may thus write 


- 2 m 
g(t) BG, РГА ( © Ta . . . . (vii) 


The table of the ¢-integral in Kendall's treatise gives the probability (P;) of a value being 
numerically as great as or greater than + f, i.e. 


1—P,—| g(t).dt. 
-t 
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In this expression g(f) is as defined in (vii), For an n-fold sample of t-scores, f = п — 1, and 
as in (v) 
_ (м„— Myvna— 1) 
om т=п П 
3 ey] 
-1 


For f = (n — 1) in (vii) the table uses the symbol».  Kendall's table cites t-ratios for 1 to 20 d.f., 
i.e. samples of 2 to 21 paired d-scores in this context. 

The i-distribution so defined would be of no particular use if our null hypothesis did not 
in fact postulate the numerical value of the true mean, i.e. M = 0 for paired differences, when it 
is legitimate to use the t-test to assess their significance. Thus (viii) then becomes 


M,Vmn—1 —— 
[Be-m] 


The orthogonal transformation employed in deriving the distribution of the Gosset ratio 
defined by (viii) presupposes that each d-score comes from a sub-universe having the same score 
distribution variance as each other sub-universe. Тһе only sense in which the sub-universe 
from which we extract a particular pair of scores can then be different from a sub-universe from 
which we extract another is that the mean value of the unit sample from one is different from the 
mean value of the unit sample from the other. Thus the t-test commonly prescribed for paired 
differences is of far more limited application than the appropriate c-test, though more precise, 
if applicable. The distribution of ? has, however, a special interest inasmuch as it discloses 
how rapidly the distribution of an empirical ratio tends to normality as the size of the sample 
increases. 

In 16.04 we have found that the ¢-distribution approaches the normal very closely for samples 
larger than 50, but for smaller samples the discrepancy is large, as shown by the following figures 
for the probability that ¢ in (ix) does not lie within the range + 2 or + 3: 


t . (viii) 


КС) 


Jeu 1) +2 PE 
t-table c-table | t-table c-table 

5 0-102 0-046 0-0300 0.0027 

10 0-073 0-046 0-0134 0-0027 

20 0-059 0-046 0-0071 0-0027 

© 0-046 0-046 0-0027 0-0027 


Evidently, it will be grossly inaccurate to evaluate P, for the ratio defined by (ix) by recourse to 
the c-table (probability integral) when the size of the sample is small ; but the error involved in 
using (i) to define the appropriate c-ratio is much less. То get the relation between ¢ of (ix) 
and c of (i) into focus, we may write for brevity 


S 4—5, ad Y (d, — My = S, —n. М 
r=1 


r=1 
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We then have 


à _ п — 0M; | TM; 
Ё S, a. M and с? Ss 
<2 n fı м (7+1) —– с 
та n—l 5, if ^ 
zx ED 
ae * : Е Б 7 sa) (x) 


This equation defines the empirical value of the c-ratio in (i) corresponding to that of 2 in (ix) 
for a specified value of f. We may denote by P, the value assigned by the normal integral to the 
probability that (i) will not lie inside the range + c, using P, as before in the ensuing table. 


$ t=2 t=3 
c Р, Р, c Р, Р, 

5 1-633 0-103 0-102 1-964 0-0496 0-0300 
10 1-773 0:076 0-074 2-283 0-0224 0-0134 
15 1:835 0-067 0-064 2-449 0-0143 0-0090 
20 1:871 0:061 0-060 2-553 0-0107 0-0071 
30 1:910 0-056 0-055 2-675 0-0075 0-0054 
40 1:931 0-054 0-052 2:744 0-0061 0-0046 
60 1-953 0-051 0-050 2-821 0:0048 0-0039 


From the above we see that the use of (i) as a normal variate underestimates the odds 
in favour of significance as assigned by the exact distribution of the corresponding t variate of 
(ix), but the discrepancy is not very gross at the 5 per cent. level. 

Numerical Example. 1n 7.07 of Vol. I we have used (i) above to test the effect of constriction 
of the vessels of a finger on the haemoglobin content of the blood drawn therefrom. The number 
of paired observations, each member of a pair on the same individual, was 39, so that f = 38. 
From the figures cited on page 316 of Vol. I we get 


$4 = 296; M, —133; Уа = 52; 
Dd — Mj = Xd: — n. Mj = 296 — 69:3 = 226-7, 
. 38.39. (1:33)? 2633-4 


Ce 


226-7 2 226-7’ 
s. t= 3-4, 
By recourse to (i) we obtain 
e=3-1. 
* * * * * * 


Confidence Limits of an Estimated Mean. ‘There is, however, another and important use for 
the t-distribution interpreted as that of the deviation of the mean (M;) of the z-fold sample 
from the true mean (M) of a homogeneous normal parent universe. It may happen that we 
want to estimate M in which case M, is an unbiased statistic ; but it is possible to take a step 
further, i.e. to assign confidence limits between which M lies. 
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We shall see how to do this more readily, if we first assume that we know the value of M 
and o?, the variance of the u.s.d., whence also o2 = (o? - л). We may denote the deviation of 
the sample mean from the true mean by h = (М. — M). By hypothesis, therefore (h — om) = c 
is a normal score of unit variance. At the 2с level h = 2e,, and c = 2. The probability 
that A will be numerically equal to or greater than 2c,, is then given by the table of the normal 
integral as 


p = ||, ассо, 
о 


Let us now suppose that we know the value of o? and hence of o7, but that we do not know 
the value of M. If (M, — M) lies within the limits + А = + 20, it follows that М lies within 
the limits (M, F h) = (М, F 2e,). Either statement is true of 95 per cent. of all samples we 
meet, and we shall therefore err in only 5 per cent. of our samples, if we consistently 
set our estimate of M in the range from М, — 2e,, to М, + 2e,. For instance, we may suppose 
the sample mean is 11:5, and that the true value of om is 0-75, so that 2e,, = 1:5. A deviation 
of 1:5 either way signifies in this case that + (11-5 — M) = + 1-5, whence that M lies within 
the range from 10 to 13 inclusive. Such then are the limits of the range of admissible values of 
M at the 95 per cent. confidence level. 

The foregoing argument presupposes that we know the value of om. This will rarely if 
ever be true in laboratory or field work, though it is easy to construct a model set-up in which 
it would be so. А more usual type of situation is that of the investigator who wishes to assign 
a value to the length of a piece of wire on the basis of successive observations (x) subject to an 
approximately normal distribution of instrumental error. He then has two sample parameters 
on which to base his judgment, viz. the sample mean M, and an estimate of the variance (om) 
of the mean, viz. : 


т=п ( х. — M} 
B an 
ЫШ 3c 
The t-distribution then defines that of the ratio (M, — M) +s». For a particular value of 
f= (n — 1) the table of the t-integral cites how large t must be if P 20-05 is the probability 
that the value of ż lies outside a prescribed numerical value. Let us suppose that the table cites 
t= +a as the prescribed value, so that 


M, — M = x as, and M = M, + ass. 


We can then say that M lies within the limits M. + а. Sm at the 95 per cent. confidence level, 
if we assign to a the tabular value prescribed by Р œ 0-05. 

For simplicity, we may take the foregoing figure for the observed mean M, = 11-5 and 
assume that Sm = 0-75 for a sample of 10, so that f = 9. For this value of f the table of the 
t-integral gives t = 2:26 at the level P = 0-05, i.e. odds of about 20 : 1 against getting a value of 
t numerically equal to or greater than 2:26. This specifies a deviation + (2-26)(0-75) = + 1-695. 
At the 95 per cent. confidence level we shall thus say that the true mean will lie in the range 
11-5 + 1-695-or from 9'805 to 13-195. For f > 50 the normal integral will give a figure which 
does not appreciably differ from the result of proceeding as in this example. The reader should 
be able to interpret the appropriate procedure for any other confidence level (e.g. 99 per cent.). 


16.06 THE Group MEAN DIFFERENCE TEST 


In contradistinction to the approximate c-test of 7.06 in Vol. I we have examined in 13.07 
an alternative approach to the recognition of a difference between the mean score of two 
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independent samples. If on esample consists of a and the other of b = (n — a) items, we may 
define two statistics as in 16.04 by the relations 


S$—aqM.,—MWNM,—My. . . . . . . () 


IE 1 $e T 
d-.—32 64—MJ4.—,2 G4-My-443 . . @ 


Tn the last expression 


i-a 1 iz 
d-,—32 u М) and $= „52 (u М, 


As we have seen in 13.07 the ratio of the two is then equivalent to 
$  (M,—My ам, – M 


с 


“(+ ier (G+ si) 


The statistics denoted by 52 and 55 are each estimates of the true variance (o?) of the score dis- 
tribution of the putative common universe of the null hypothesis, i.e. that the column samples 
do in fact come from one and the same universe. "Their consistency is therefore a criterion of 
the absence of a difference between the column means other than such as might arise by random 
sampling. We may express the ratio defined by (iii) as 


(iii) 


х = (п — 2), 
d 
Е а (iv) 


From (xxxii) and (xxxvi) of 16.04 we can see that R? expressed in this form is the ratio of a Chi- 
Square variate of 1 d.f. to a Chi-Square variate of f = (n — 2) degrees of freedom. ‘The problem 
of the distribution of R is therefore soluble, if we can show that these are statistically independent. 
We first recall a result obtained in 16.05, where we have seen that it is possible to express the 
numerator of (iv) in terms of two independent normal scores of unit variance, viz. : 


ie sn 


In (v) the meaning of v; and v, is 


(м.м) a м. M) 
Oa о 


е = 


„We may transform the denominator in (iv) as follows : 


(n — 20 -$ вы — М) "x (£o; — My a(M,— My _ b(M, — My 


E oi в? о? 
pou (М, — My 
“ше % % 
le v Лу ж ма, КЕТ B 


т=1 
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If we put (02 + 02 4- 02... 02) = (d ++... с) in the usual way we may choose 
the linear constants connecting any v-score with the c-scores so that the v-scores are themselves 
independent normal scores of unit variance, and (vi) becomes 


PM атана... 


=(0 +... v8) 5 * л : E . (мі) 


Since v, and v; are independent of vs, vg, etc. (v) therefore defines a statistic which is independent 
of (vii). 

Thus the ratio R? in (iv) is a Type VI variate of the same form as (vi) in 16.05, and its square 
root (R) is a Type VII variate. If we write (n — 2) = f. 


1 


PR) = ga, apd + RR 


We may express the square root of the ratio defined by (iii) in the form 


ue EM =t=Vf.R Е i) 
(i -)eee 
t 
DT 
1 


сс Ба 
Baan У7(1+5) _ 


Thus the ratio ¢ so defined is a t-variate of f = (n — 2) degrees of freedom. 


Numerical Example. "The following data refer to the bispinous (sacral) width of boys and 
girls aged 9-9} years. 


No. of No. of 


Cm. Boys Girls Total 
65 0 2 2 
70 4 8 12 
75 6 4 10 
80 8 9 17 
85 6 1 7 
90 0 1 1 
95 H 0 $ 
Total 25 25 50 
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From the above we have a = 25 = b and п — 2 = 48. We denote the boy's score by x, and the 
girl's by хь: 


Ух, 19750; М,= 790; aM? = 1560-25 ; 
Уа? = 156925; YX(x,— M! = Ух – aM? = aV, — 9:00 . (x) 
Ух, = 18850; M,— 754; bM; — 142129 ; 
$3 = 148075; X(x — M)? = Xi — bM? = bV, = 946 ss) 
Zoe cn =772=My; nM} = 2979-92; 
D@ Ma = Уз + У пм3=2008 . . . . . . (x 
(Ma — M} = 0:1296. . . . . . (xii) 
From (ix) and (x) we have 
Ук. = М) 9 
2 = 8 38-0185; 
У( = м) 946 
= == Т = 0-1971. 


Whence from (iii) : 
ab(M,— Му): _ 625 (0-1296) 
n(sq + Sp) 50 (0-3846) 
= 2:05. 


" 


= 4212, 


"The corresponding ratio for the approximate c-test of 7.06 in Vol. I is given by 
ab(n — 1)(M, — M,)* 625(49)\ 0-1296) _ 
n> (x — May 50 (20-08) 
* € = 1:99; 


с? 


= 3-95 


16.07 TESTING THE VARIANCE RATIO 


From quite different approaches, we have arrived at the definition of two statistics respec- 
tively for testing the reality of a difference between paired sets of observations and between 
group means, each statistic being expressible as a ratio of independent sample variances and 
hence as the ratio of two independent Chi-Square variates. This ratio (t?) is in fact a Type VI 
variate, but its square root is a Type VII variate, because the numerator happens to be a Chi- 
Square variate of 1 d.f. Except when we have to deal with a set-up having only 2 columns 
and/or two rows, the variance ratios defined in 13.03-13.06 as criteria of homogeneity in connexion 
with the procedure known as Analysis of Variance involve in both dimensions Chi-Square 
variates with more than one degree of freedom. Usually therefore the table of the ¢-integral is of 
no assistance in assessing their significance. 

On the assumption that the numerator is statistically independent of the denominator of 
such a ratio, the general procedure (F-test) follows from what we have learned in 15.04 and 16.04. 
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We will suppose that s? is an unbiased estimate of the true variance (o?) with a degrees of freedom 
and s; another estimate with b degrees of freedom. To say this is to say that 


DH. à 
=з is a Chi-Square variate of a degrees of freedom ; 


t4 is a Chi-Square variete of b degrees of freedom. 


Sto 


As a criterion of the consistency of the two estimates we define the variance ratio 


EXE ce 0 9 xo ctum 


Let us now write 


(ii 

If s; and s? are independent statistics we have seen that x is a Type VII variate, being the ratio 
of a Г($а) to an independent I'(35) variate, i.e. 

Е) ai 

eee | ee 


Thus we have 
1 ай@- path pia-2) 


Хә) B(ja, 3b) 96-9 (b F аЕуе+® 
aD 0+2), pia 2) 
~ Ba, 100 + ару? ` 


"То obtain the distribution of F, we make the usual scalar change, viz. : 


ФР) = 70905 = 3/0) 


(iv) 


Whence from (iv) above 
ait p^ , рка 2) 


$F— aad» aFye a oct os (у) 


"The expression defined by (v) is equivalent to the most general form of Туре VI given by 
(xxi) of 15.04. We may write it alternatively as 


Y нея 
ide, i. (Lr) ^ 


In the above (a7) replaces & in (xxi) of 15.04 in which m = 3a and п = 35. By (xxiii) of 15.04 
the mean of the distribution is 


ФЕ) = (vi) 


hm b (ja) b ы 
=т=т Таш 0 з СА) 


Thus the expected value of F tends, as one might expect, to unity when 4 is large, since F is the 
ratio of two independent estimates of the same parameter ;; but it will be appreciably greater 
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than unity when b is small. If the denominator of the F-ratio is s? as defined in 13.03, it has the 
degrees of freedom corresponding to b, i.e. (r — 1)(с — 1). Fora3 x 4table(r — 1)(с — 1)— 6 
and the mean value of F will be 1-5. 

The probability (P,) that the ratio F will have a value as great as or greater than и, which we 
here assume to be greater than its expected value py, is given by 


P, -F &(F)dF and [wear = I 59 


Of course, F may also be less than its expected value, and the probability (Р,) that it will be as 
small as or less than v is given by 


P, = ЖЕЕ Sass rt te. Xen dex 


To say that 5 per cent. of the area bounded by the curve lies in the range from и to оо, i.e. 
P, = 0-05 means that the odds are about 20 : 1 against getting a value of F as great as or greater 
than u. Likewise P, = 0-05 signifies that the area from 0 to v is also 5 per cent. of the area 
bounded by the curve, and the odds are about 20 : 1 against getting a value of F no greater than v. 
However we need not concern ourselves with the improbability of getting a value of F less than 
the mean, if we take advantage of the reciprocal property of the Type VI variate (Ex. 3, 15.04). 
If Z is the reciprocal of F, i.e. Z = Е, 
Ge gie-2» 
5 


Ba, "c E DU 


"This is a Type VI variate of the same form as (vi) with interchange of constants, i.e. degrees of 
freedom. When F = u, Z = u^? and when F = oo, 2 = 0. The change of sign in the trans- 
formation from (vi) to (x) as we have noted in 15.02 means that 


| «Far – l дал, 


° 
Ши 


2) = (х) 


s: | (ЕДЕ = [г 2) 42. 


If v = u^, the probability that F will have a value as great as or greater than и is therefore 
the same as the probability that Z will have a value as small as or less than v. Now our 
concern is merely with the consistency of the estimates 52 and sj. It is therefore immaterial 
whether we chose 52 as the numerator and s? as the denominator of F or vice versa, so long 
as we use the appropriate Type VI variate, viz. (vi) or (x), as the case may be. For economy 
of tabulation we may define 52 as the greater of the two estimates, so that F itself is always 
greater than unity. 

Evidently complete tables of F so defined for a wide range of corresponding values of a 
and b would fill a bulky volume. Snedecor’s condensed table gives two entries in each cell for 
corresponding values of a (ау, аз, etc. below) and b (b, bs, etc. below). The first (Fo.o5) is the 
numerical value of the variance ratio bounding the 5 per cent. tail of the distribution, and the 
second (Гоо) is that which bounds the 1 per cent. tail, і.е. the odds are about 20 : 1 against 
getting a value of F as great as or greater than F,.; and the odds are about 100 : 1 against getting 
a value of F as great as or greater than Fy.9,. The lay-out is then as follows : 
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am a 4 > 
b 
by 

Жа 
bs nds 
bs 


If a = 4, and b = 8, the two entries are 3:84 and 7:01. This means that for the ratio F = 52 + sz 
of two estimates 52 with 4 and s; with 8 degrees of freedom, the odds are less than 20 : 1 against 
getting a value F > 3-84 and less than 100 : 1 against getting a value F — 7-01. In other words, 
F — 355 is below the 5 per cent. significance level, F — 5 is above the 5 per cent. but below the 
1 per cent. significance level, F — 10 is above the 1 per cent. significance level, i.e. there are 
adverse odds of more than 100 : 1 against getting a value solarge. Any such value of F of course 
implies that 52 > зу. The reciprocal of the value 7-01 is approximately 0-14. If our tables 
recorded the value of F for sẹ > s? we should therefore find the entry Ру. = 0-14 for а = 8 and 
b —4. 

En passant, it is worth whileto recall the distinction we have drawn between vector and modular 
probability in Chapter 5 of Vol. I. When we speak of a 5 per cent. significance level in connexion 
with the normal distribution, that of the 1-variate or of other symmetrical function with mean 
as origin, we commonly specify a range of numerically equivalent score values of opposite sign 
with a total expectation of 0-05, i.e. an expectation of 0-95 that the score value will neither be 
as great as a given score value nor as little as the same score value with reverse sign. This is 
a significance level referable to modular probability. The significance level we specify above 
in connexion with the F ratio is referable to vector probability as defined elsewhere, since we 
are concerned only with the improbability of getting a value as great as or greater than the 
observed one. 

To justify the use of the F-test it is, of course, necessary to establish the statistical indepen- 
dence of the statistics 52 and s? in the numerator and denominator. In 13.03 we have seen that 
homogeneity w.r.t. 2 criteria of classification implies the consistency of the estimate s? with 
52 and 52, i.e. 

(c — 1)? (r— 1)? 


cies end Кене тр 


For the 3 x 4 table we obtained in 16.04 above : 


(r — yc — 1) 
TEC 2 2 
vi LR us + Ug + ig + tiy + Ufe. 


By definition 
G= 5-28 I= (M, — = P 4c(M,—M» (M,—M)? 
E à 3 2 
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or the same set-up, therefore, 


=I Я 
CODE = (uh bub 08) — ut = ad + 


More generally, 
— 1)(с — 1)? sare = r 
Kami Gt ie S > ш and е sey I5 9. 
e=rte =? 


"Thus the denominator of F, so expressed contains no one of the independent u-scores present in 
the numerator. Similar remarks apply mutatis mutandis to the ratio F,. 

For a rapid computation we employ the symbolism of 11.05 (p. 448-458) and 13.04 
(р. 552), viz. : 


j=art= i=e jet 
SI з; S=7c.M*; S rM: S,=c > Mj. 
j714-1 i=l е1 


In this notation 
(e — 1)2 = S. — 5; (r — 1)? = S, — S; (r—1)(c — 1)? = S, + S— Se — S. 
Whence for testing column and row effects against residual variance, 
Rote (7 — 1)(5.— 5) = (c — 1(S, — S) 
2 S,+ S—S,—S,’ $ S,+S—S,—S, 


The case which arises when there are only 2 columns, so that (c — 1) = 1 and hence 
there are r pairs of scores, is of special interest. In this case we may label the two column 
means as M, and M, respectively, distinguishing corresponding raw-scores as Xa; and хь, so that 
M, = (ха; + хь) and 


jer 
S= У (x3 +23); S=2r. MP = 5 (M. + M}; 
j-21 


F, (xi) 


izr izr 
S, = (M3 + Mi); S, Cc È М =} У (tar + xy. 
j=1 


j=1 
It is possible to express these quantities in terms of the paired score differences (xas — xy;) = d; 
and their mean M, = (M, — M,), in virtue of the identities 


Xas + Xos = 2x, — dy and M, + M, = 2M, — My. 


We then have 
c 
Sa = У (252 — 2ra. dy + 4); S= 2r. M3 — 2r. Ma . Ma + dr. M; 
j=1 


j=r 
S. >. (2x3 2x3. di + 4dj) ; S, = 2r. Mi — 2r. M,. Ma + r. Mi; 


= 


jer 
S.—S=<Mi and S,-+S—S,—S,=4 > dj —4r. M? 
j=. 


Whence by substitution in (xi) we obtain 
r(r — 1)M; r(r - 0M; 


Sa@—r.m F(a- My 


j=l j=l 


F,= 


Boe e (xil) 
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Numerical Example. The following simple set of figures will serve to illustrate both com- 
putations involved in the use of the F-test to evaluate the nullity of the column criterion and 
its identity with the 7-test for paired differences when there are only 2 columns and 2 criteria of 
classification. The set-up is for 3 rows (individuals) and 2 columns (successive score values) 
on the same individual : 


Whence we have 
Column Means: M, = 3; M. = 5. 


Row Means: M4, =3; M..=3; M.,=6. 
Grand Mean: М = 4. 
Total Sum of Squares: S, = 118. 


i= 
5 = ғс.М= 9%; S, =r > M? = 3(3° + 5°) = 102. 


i=l 
j=3 
S, =c > Mj = 23? + 3° + 6) = 108; 
j=l 
уыл SE (r — 1)(с — 1) 2(102 — 96) . 
2 с—1 5+5—5,—5, 118496—102—108 ` 


The differences are 


d, 2; d4—0; dj —4; Ma 2; 


j=3 
> (0, M} =0+4+4=8; 


j=1 

а le UM itd 3. 
> (d, — Ma} 
j=1 

* * * * ж + + 


Evaluation оў t-Test for Paired Differences. From опе viewpoint the identity exhibited in 
(xii), namely, that F, is equivalent to the so-called Student statistic 22 for r paired differences when 
с = 2 is not surprising, inasmuch as we have seen that Туре VII is the distribution of the square 
root of a Type VI variate when the numerator of the F-ratio is a Chi-Square variate of 1 d.f. 
Indeed, we obtained (vii) in 16.05 from the same equation as (iii) above. If f stands for the d.f. 
of the t-variate, the relevant substitutions made in deriving (vii) of 16.05 and (vi) imply the 
formal identity established above, viz. : 


к MG aes T whens esa ye 1) 


бт 


SIGNIFICANCE TESTS FOR ANALYSIS OF VARIANCE 795 


In short, the paired difference test based on the t-distribution of 16.05 is exactly the same 
as a homogeneity test when the end in view is to decide whether a difference between column 
means is wholly attributable to residual sources of variation after eliminating variation associated 
with the row (pairing) effect. Now this identity brings sharply into focus a latent and not 
commonly recognized assumption in the prescription of the t-test for paired differences. Im- 
plicitly, we postulate that any row effect is strictly additive, in accordance with the following 
schema of score components : 


Column A Column B Difference 
Xa = ёа F, хы = en +F d, = ea — ё 
Хоз = eag + Fy Xr = en + Fa d, = eag — erg 


Хаз = ёз + Fy Xos = en + Ёз d, = eas — бз 


d, = 6. — ё 


Wap = 


In this assumed schema, the dispersion of our e-components accounts for all residual variation, 
if the null hypothesis under consideration is correct. Hence we may regard each pair as a 
sample from a sub-universe which differs from any other such sub-universe only in virtue of a 
factor Е, determining the origin of the score distribution. In other words, our latent assumption is 
that we take our samples from strata of a score distribution different inter se in one respect alone, 
viz., that the mean score values of different strata are different, the variances of the sub-dis- 
tributions being identical. 

That we do, in fact, assume equality of variance in the derivation of the t-test prescribed for 
paired differences will be evident, if we retrace our steps to the beginning of 16.05. To express 
the square of the mean d-score in standardised form as an eliminable component of the denomi- 
nator and hence to establish that the denominator and numerator are independent variates, we 
have to assume that we draw each d-score from a normal sub-universe with the same definitive 
parameter с. Otherwise, the appropriate orthogonal transformation is unrealisable. 

"This raises an issue of practical importance : in what circumstances сап we invoke the t-test 
as an appropriate procedure, if we take advantage of the possibility of pairing observations in the 
design of an enquiry? The applicability of a t-test to evaluate the odds against a mean paired 
difference score exceeding its expected value of zero by such and such in fact demands answers 
to two questions : (2) whether we are entitled to regard members of one pair as different from 
another only in the sense that the mean of an indefinitely large number of observations on 
members of one pair may differ from the mean of an indefinitely large number of observations 
on another; (b) whether we are entitled to regard successive observations on members of the 
same pair as referable to a normal universe. 

To the first question we can give a positive answer in very restricted circumstances, e.g. 
(a) if the members of a pair constitute measurements respectively made on one and the same 
individual before and after some treatment procedure ; (6) if also the interval is sufficiently 
short to justify the assumption of no relevant change on the part of the individual and hence no 
source of variation other than error of measurement. The null hypothesis is then that paired 
differences arise in virtue of errors of measurement alone. If the technique of estimation is the 
same w.r.t. all such pairs, this implies that the variance of score values for successive individual 
measurements оп one pair is the same as for ell others. Тһе example given in 7.07 (p. 315) 
conforms to this requirement. Each pair of observations involves local measurement of haemo- 
globin of the finger of one individual : (a) before ligation, (b) after ligation of the same finger of 
the same individual, the intervening period being short. In this set-up, the null hypothesis that 
ligation has no effect implies that the only source of variation is error of haemoglobin estimation. 
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By pairing our observations we make it possible to eliminate the variation arising from the 
fact that mean haemoglobin observations made on different individuals are likely to be different ; 
but the mere fact that measurements of a pair refer to the same individual is not alwaysasufficient 
guarantee that our sample of d-scores is referable to sub-universes of equal variance. If the 
interval is long we may introduce diurnal or other sources of variation which we cannot interpret 
with confidence. Such is indeed a permissible criticism of the choice of a widely quoted 
experiment used by Gossett himself to illustrate the uses of the t-test. In experiments on highly 
standardised laboratory stocks reared under a highly standardised regimen, we may be entitled 
to dismiss this consideration ; but pairing of observations on different individuals will rarely 
justify the use of a significance test based on the assumption that the d-scores are samples from 
a homogeneous normal universe. If we investigate the effect of an increased milk ration on the 
growth of children, we may eliminate certain fairly obvious sources of error by selecting as one 
member of a pair for treatment an individual of the same sex, age and build as the untreated 
member ; but we have no sufficient reason for assuming that variation of response to treatment 
is uniform from pair to pair. 

The fact that we can rarely invoke with propriety the postulate of equal variance, unless the 
only residual source of variation is instrumental, reinforces the relevance of the second question 
raised ebove. In many types of experimentation, the range of sampling variation is small and 
the number of score values consistent therewith is also small. In short, the situations in which 
we can most confidently condone the assumptions implicit in the t-test for paired score differences 
are often such as to dictate justifiable caution w.r.t. the assumption of normality. Fortunately, 
our excursion into the burette universe of 14.05 has a lesson to offer in this context, viz., that 
the mean difference of repeated pairs of observations on the material tends to normality fairly 
rapidly even if the number of different values consistent with good workmanship is small. 

Since we should therefore exercise restraint in using the t-test for paired differences, it is 
important to realise that the c-test prescribed in 7.07 of Vol. I and referred to in 16.05 of this 
chapter is for reasons set forth more fully in 14.08 free from the objection that it implicitly postu- 
lates equality of variance. Subject to the recognition that it shares with any approximate c-test 
(including the sc-called Chi-Square Test for the 2 x 2 contingency table) a measure of uncertainty 
arising from the use of an estimate of the variance of the mean, it is equally applicable to any 
situation in which we can eliminate known sources of variation whether by pairing observations 
on the same individual or by pairing like individuals, as when one compensates for unequal 
overhead illumination or local temperature differences due to draughts by pairing off in a green- 
bouse pots of plants of the same stock subjected to different treatments. 


16.08 THE CORRELATION RATIO 


Any significance test for homogeneity derives its rationale from the distribution of inde- 
pendent estimates of the variance (o?) of the unit sample score distribution of the putative 
common universe. For a set-up involving one criterion of classification associated with the 
columns, our statistics are respectively referable to the variance of the column-means and of the 
mean variance of scores within the columns. For a 2-way lay-out we employ one estimate 
referable either to the column-means or to the row-means and a second statistic (52) referable to 
the difference between the total variance (V ,) and the sum of these two. At first sight it would 
seem more reasonable to choose an estimate based on the total variance as our second statistic in 
either case, i.e. s? defined in 16.04 as 


TC T 
imc 4 DNE 
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From this expression we can derive the Chi-Square variate with (rc — 1) degrees of freedom : 


rc — Ys m 

TEM 3 (ii) 

Thus z defined as below defines the ratio of 2 Chi-Square variates, involving the ratio of 2 
unbiased estimates of o? : 

E 1)% n 

z= ее — . . . . . (ш) 


If we make the appropriate orthogonal transformation we see that this is not the ratio of 2 
independent Chi-Square variates. ‘Thus we may express z in accordance with the procedure of 
16.04 as 
NEL EL EL niis 
нй a È 
а c-u... 
(tus. o u) + (leži + ete + + + Ure) 


In the foregoing expression the denominator contains all the square u-scores present in the 
numerator, but we can express it as a function of the ratio of two independent sets of u-scores 
if we divide the numerator and denominator by (u3 + u$ . . . u2), so that 
1 1 
s= eA 1 : 
Es uL TIDAL +x 


123-439... 


(iv) 


" ЧУ) 


In (у) the numerator of x contains rc — (c + 1) + 1 = c(r — 1) terms like s2 of (xxxvii) in 16.04, 
if the columns contain an equal number (7) of rows. When our concern is with only one criterion 
of classification, we may write rc = n as in (xxxviii) of 16.04, so that c(r — 1) = (n — с). The 
denominator contains (c — 1) independent terms, so that x has the same distribution as 


(n — os 
(c— Ise 
We might arrive at this conclusion by using the tautology of the grid. By definition 
TC n TC n 
у= Poem 1 0 ua 1 (M9 and #= a= б=т” 
c—1 n—1 
5 5; = V(M.) and = s$ = И, = V(M.) + М(У,), 
V(M.) = 1 
ИМ) + MV) 4, ШИРИ 
ҮМ.) 
In the above 
(n— oc), - " 
== MU, 
.MV) (—os ^ 
Dub Е cce corso edm 


10 
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Thus x is the ratio of two independent Chi-Square variates. If we write 
a=(n—c) and b—(c— 1) 


for brevity, so that a and b are the d.f. of numerator and denominator, the p.d. equation of x is 
given by 


pe-a Е 
IO = р 0 Farr (vii) 
In 15.02 we have seen that the p.d. equation of ж = (1 + x) is therefore 
210—2 (1 — zjie-2 
F(z) = ——._—____-. 
= Bae) 
Or more fully 
àe- 301] — gn-e-2 
a= Lime . (viii) 


с—1 n—c 
0-5) 
Thus the distribution of the ratio defined by z is a Туре I variate within the framework of the 

implicit assumption that the column samples come from the same normal universe. 

Evidently the tabulation of the Type I variate а could give us no information which we cannot 
derive from the Type VI variate x if our only concern were to establish homogeneity w.r.t. the 
column criterion of classification. ‘The interest of its distribution lies in the fact that we can 
express either correlation ratio of a bivariate distribution as a function of the same form. We 
have seen in Chapter 10 of Vol. I that it is always possible to lay-out a bivariate frequency grid 
as a grid of one or other set of score values, as in the numerical example of the accompanying 
table; and we may analyse either set of scores w.r.t. one criterion of classification by putting in 
the same column scores which go with one and the same value of the alternative set. The 
number of rows in each column will not necessarily be the same; but we have seen (13.07) 
that this is immaterial, when our concern is with a single taxonomic criterion, here taken as 
that of the column heading. The 2 score-grids so constructed respectively set out the relevant 
data for the evaluation of 


2 ИМ.) _ VM) 


nab апі 7g (ix 
= [7 oa V, ) 
Frequency Grid 
A-scores 
0 1 2 3 Total No. Ma 

o a 2 1 0 | 4 | 1 
B-scores 1 1 1 2 1 5 | Fy 

2 0 2 2 3 7 | m 

Total No. 2 5 5 4 16 м.=% 
Mie RETE з i i M-i 
| 
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 Score-Grid (A-scores) 


0 0 1 
1 1 1 
1 2 2 
2 2 2 
Д 3 3 
.. 3 
3 Total 
n 4 5 7 16 
M, = Ma 1 1 A M=} 
Score-Grid (B-scores) 
с, с, C, 


1) (24-2) (@=3) 


= 
в 
1 


In the symbolism of this context we may define either ratio with appropriate alternative 
interpretation of the column criterion as 


In this expression V, is the total score distribution. If the grid items are A-scores, V, = V, ; 
and M, being the mean A-score for a column defined by a fixed B-score value, M, = И. 
We then interpret the above 72, in accordance with (ix). Conversely, the B-score-grid V, = Vy, 
M, = M,, and 7? = р. For either grid, the total number of entries is n = rc if the columns 
contain equal number of items, otherwise 
nc т. 
i=l 
In either case, we may put 


y Qu en 
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In this expression n? is identical with z as heretofore defined, and its distribution is defined 
by (уш). From (xix) of 15.04 we see that the mean value of z = 7° is 


est 
ае 


We can test the significance of a correlation ratio defined by (viii) om the assumption of 
independence, and hence of zero correlation, by recourse to the F-table in virtue of the identity 


OU 
XT Tox 
Tn virtue of the reciprocal property of the Type VI variate (Ex. 3 of 15.04), we have 
uke-8) 


glu) = . 
в( = Un = ja quje 


In this expression the appropriate F ratio is given by 


(n—c) т ; 
mE Ds ^ А : = „ (xi) 


Numerical Example. From the score-grid for A-scores in the accompanying table we get 


van) = М — sa — Hy A — HY ex — Hy = 02118; 
y, -20- H* c5 - ДЕНЕ HEMSE age 
= M 0-194, 
7 Sx = ae = 0:2413, 
NNI S 


@—1)°1—% 


In (v) of 16.07, (3 — 1) = a = 2 and (16 — 3) = b = 13. The Е table gives 


a=2,b=12 a=2,b=14 
5 per cent. level . : A - 3:88 3:74 
1 per cent. level . : à ó 6-93 6-51 


"Thus the observed F-ratio is below the 5 per cent. significance level. If we proceed in the same 
way for the B-scores : 
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M,— М, 
им) S "ОМ аа р Е DP + aed Dr- 01531; 
20 — $+ 5(1 — 8% 52 — DF 43 — D _ 4 1563. 


Ve 16 
ng, = 10D — 01324; 
А _ 0134 _ 
pog юше 0195: 
(6 — 4) 
= L2 = 06104, 
4—4) те = "E 


In this case F — 1. Since the F-table cites significance levels only for values exceeding 
expectation, we make use of the reciprocal property of the F-variate, i.e. we ask what would 
be the expectation of getting a value as great as (0:6104)-! == 1:54. We must then reverse the 
degrees of freedom, by putting 16 — 4 = a = 12 and (4 — 1) = 5 — 3. The F-table gives 
a=12,b=3 
5 рег cent. level . 8:74 
1 рег cent. level — . 27-05 


Again the result shows no significant departure from zero correlation. 


CHAPTER 17 
REGRESSION AND DISCRIMINATION 


17.00 REGRESSION IN REAL WORK 


So far we have gained our acquaintance with the concept of regression only in the domain of 
statistical models based on games of chance. We shall now consider it as a tool in the day's 
work. ‘Though the statistical procedure subsumed under the term regression owes its name to 
Galton and its literal meaning to Galton's erroneous views about inheritance involving many 
gene substitutions, it is essentially one which physicists have used under a different designation 
for more than a century as a curve-fitting device due to Gauss. It is not easy to evaluate its 
proper uses nor to recognise what pitfalls beset its applications unless we delve into this back- 
ground, as we shall now do. 

In the domain of statistical models, it suffices to define regression of the linear type in purely 
algebriac terms, viz. regression of the B-score on the A-score is linear if the B-score means 
respectively associated with successive equally spaced values of the A-score increase by equal 
increments. To say this is to say that they constitute an arithmetic series and as such would fall 
on the same straight line if plotted against the A-scores graphically. When discussing experi- 
mental data, the geometrical definition has certain advantages which will emerge in what follows. 

‘The Gaussian origins of regression have to do with the problem of determining agreed values 
of the definitive constants of a straight line law. Needless to say, a linear law is not a common 
type in the exact sciences ; but a suitable score transformation suffices to reduce a non-periodic 
physical law to the linear form. For instance, we can express Boyle's law (pv = Ё) in the form 
р = kd by the substitution d = v-!, and plot mean values of d against fixed values of p to deter- 
mine the regression constant k. Thus the issue, as stated above, is of more general interest than 
would appear at first sight. It arises in a multiplicity of situations which demand the adoption 
of a universally accepted numerical value for a physical constant on the implicit assumption that 
there exists a true law of a type amenable to expression in linear form. 

It is of paramount importance to recognise the implications of the assumption last stated. 
It may be easier to get them into focus if we take the simplest possible example of a physical 
law as a type specimen. One of the few examples of a familiar physical law commonly stated 
in the linear form is the law of Hooke (ut tensio sic vis) connecting the length (/) of a spring with 
the load or tension (t) applied for values of the latter not too near the elastic limit. The law 
is linear if 

l=k.t +C. 
In textbooks we commonly meet it in the form which the above assumes, if we denote by /, the 
unstretched length when 2 = 0 : 

(—L)-h.t. 
So stated, (Z — /,) = s is the stretch, and we may more briefly express the law as s = kt. This 
is, however, an idealised statement of any laboratory situation. 

In real life we do not expect that all our observations, however carefully made, will fall 
exactly on a straight line or other descriptive curve. Even if we can eliminate all extraneous 
sources of variation, e.g. condensation of moisture on the scale pan, we know that successive 
observations involving no change of the controlled variable—as when we use the same box of 
weights—will involve instrumental errors, e.g. discrepancies in successive readings of a vernier 
scale; but we may have reason to believe that errors in this sense are not systematic or at least 


REGRESSION AND DISCRIMINATION 713 


that we can arrange matters so that they are not. This is to say that numerically equivalent 
positive and negative deviations about an assumed true value cancel one another in the long run, 
the mean value of successive observations referable to one and the same value of the variable 
under experimental control—in this case Joad—being therefore an unbiased estimate of the 
one deemed to be true in this sense. 

In so far as we can rightly make this assumption, sufficiently justified by experience in many 
laboratory situations, statement of the law is wholly explicit if we write M,., as the mean of 
an indefinitely large number of s-scores referable to the same t-score, so that 


M,.,=k.t. 
For а fixed set of t-values we may write E(t) = M, and Е(М,.,) = M,, so that 
M,.,— M, = k(t — M) я : * : 28] 
For a discrete distribution this expresses the belief that the universe or true mean value of s-scores 
associated with particular t-scores constitute an A.P. when arranged in accordance with corre- 
sponding equally spaced successive values of the /-ѕсогеѕ, in which case certain tautologies 
established in 11-04 are necessarily true. In particular 


ee ..... .@ 


Equations (i) and (ii) above define the properties of the universe of our observations. We 
shall later see (17.01 below) that the sample statistic calculated on the same basis as (ii) is in 
fact an unbiased estimate of the true value (k) of the physical constant. First, however, it is 
important to be clear about all the assumptions we have so far made. Our interpretation of a 
physical law exhibiting the dependence of a B-score on an A-score presupposes that 


(а) to each observation x. a for a fixed value of the A-score corresponds a true value—the 
regression score х,. ,—from which the observation deviates by an error or є-5соге (6.5) ; 

(b) the regression scores lie on a straight line each such score being identical with the 
corresponding mean B-score (Ms. a) in the universe of all samples ; 


(c) the observed B-score (x,.,) for a fixed A-score thus consists of two additive com- 
ponents which we may express by the relations 


ж.а 77 е.а Fs and х„„=М,.„ _ . 2 v (iii) 

(d) these components are statistically independent, the e-scores being distributed random- 
wise about zero mean ; 

(e) the distributions of the B-score for different fixed values of the A-score therefore differ 

solely in virtue of the fact that different values of x,. = My.a fix the origin of the dis- 

tribution, whence И. is constant and the universe is homoscedastic in one dimension ; 


(f) since x,. is constant for a fixed value of the A-score, the corresponding variance of 
the B-score distribution is the variance of the e-scores, i.e. 


VA Sé SELL el ee ычу 


Within the sample, regression will not be exactly linear, but we can define a set of hypothetical 
regression scores (х,. as) having this property, as in 11.04, and a sample statistic k, as the slope 
of the line on which they lie. The use of a sample statistic k, based on corresponding sample 
values of s and t to estimate А in (ii), as illustrated in the numerical example at the beginning of 
18.02, is what physicists call line-fitting by the method of least squares. We may regard the latter 
as a procedure for obtaining an estimate with a confidence interval as small as possible at a 
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particular confidence level; but a general proof that such an estimate is unbiased in the sense 
that the long-run mean result of applying the prescription is the true value of & is laborious. 
Accordingly, we shall defer its consideration till we have determined the unbiased estimate of 
the regression coefficient by another method. It will then take its place as a particular illustration 
of the principle of minimal variance, when we ask whether the unbiased estimate under con- 
sideration is also an efficient one. 

The least square method derives its rationale in part from the assumption of a normally 
distributed set of B-score values and a more general approach to the issue stated at the beginning 
of the last paragraph is easy to visualise. In determining an unbiased estimate of k, we shall 
make no assumptions about the law of the distribution of errors, any such assumption being 
indeed highly questionable in many real situations. The reader who has consulted treatises 
which present the use of regression analysis against the background of the so-called bivariate 
normal universe will notice that certain assumptions commonly presented as deductions from its 
properties are logically implicit in the concept of a physical law, in particular for the reason 
stated in (e) above, homoscedasticity, i.e. equal variance of the B-score distribution for different 
values of the A-score. 

Now this property is one-dimensional. Our formulation of a law relating the mean B-score 
to the A-score implies nothing about the distribution of the A-scores for fixed values of the 
B-score in the context of the experiment. The range of A-score values, and the number of each, 
depends on the way the investigator carries out the experiment ; and we are entitled to regard 
any one experiment as a sample of an indefinitely large number of experiments carried out in the 
same way. Commonly, the fixed A-scores, or independent variable in the Cartesian sense, 
represent the one easiest to control; but we may often reverse the procedure. For instance, 
we may fix the vernier of a micrometer to read when the stretch of a spring attains a certain limit 
and measure repeatedly what we have to add to the scale pan to achieve the result. If so, 
we make t in the relation s = kt our dependent variable and must reinterpret k accordingly. 

We shall refer again to this duality of regression in 18.03 below. Here it is admissible to 
forestall an unnecessary difficulty which the reader may have experienced if already acquainted 
with the concept of a bivariate normal universe. Within the framework of the dubious assumption 
that errors involved in determining the B-score for a fixed A-score and vice versa are both 
distributed normally, the solid model of a universe which is normal in both the B-dimension and 
the A-dimension of the grid corresponds to reality only in the sense that it embodies the possi- 
bility of carrying out an experiment in one of two ways. The conduct of any actual experiment 
is ipso facto unique in the sense that it refers to one set of fixed scores, the distribution of which 
depends on the observer's choice. In so far as our concern is with the uncertainties arising 
from error in the procedure we do in fact adopt, we cannot therefore conceive of the experiment 
as a sample from a universe in which the score distribution is normal in both dimensions. If 
we choose to take equal numbers of measurements (B-scores for each of a particular set of 
A-scores), the assumption of normally distributed errors implies that our sampling universe is 
normal in the B-dimension and rectangular in the A-dimension, and if we chose to describe it 
in the language of 3-dimensional geometry the frequency surface is less like the sugar loaf of 
the bivariate normal universe than the outside of a Nissen hut. 


17.0 PRINCIPLE OF THE FixED-4 SET 
The models of 12.01-12.09 define the unit sampling distribution of different universes of corre- 
lation. We shall now attempt to break down the distribution for samples of more than one 
item from a bivariate universe so conceived in accordance with the considerations advanced 
in 12.00. 
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2 FACE PACK - UNIT SAMPLE DISTRIBUTION 


CECI CEI EB ә 


TE EHI ЕТ EET aga 
ооо ооа опо ооо [Те] UNIT GRIDS 
ODOR CLIJ DEBRIS dei CAO 


Fic. 118. For explanation see text. 


Our model universe, from which we sample with replacement in conformity with the 
assumption that it is both discrete and infinite, will be a pack of cards made by gluing pairs of 
cards face upwards, so that one face bears 1, 2 or З hearts (A-score) and the other bears 1, 2 
or 3 spades (B-score) as shown in Fig. 118. The universe (unit sample) bivariate distribution is 


Sa Xe LT 2.1 2.2 2.3 3.3 
proportions р q r s t 


That we sample with replacement for the reason set forth in 12.00 means that the distribution 
of 2-fold samples is deducible by the chessboard procedure (Fig. 119) of which the equivalent 
definitive multinomial is (p + g + 7 + s + 0°. By successive application of the chessboard 
device, we can visualise the extraction of n-fold samples in accordance with terms of the expansion 
of(p--q--r--s--ty. Thus the probability of getting one paired score of (1.1) and 2 
paired scores of (2.2) in a sample of З is 3pr?, and the 3-fold sample grid is then 


10* 
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DERIVATION OF A 2-FOLD SAMPLE DISTRIBUTION 
FROM THE 2 FACE CARD PACK UNIVERSE 


Fic. 119. 
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We may classify our samples of 2, 3, etc., in fixed-A sets, i.e. sets of samples having the same 
border A-score distribution. For 2-fold samples (Fig. 120) of our 2-face card-pack model of 
5 paired score classes, there are 6 such sets, labelled Asoo (x, = 1 twice), Ayo: (ха = 1 once and 
х, = З once), etc. Fig. 121 shows all possible samples of З classified in the 10 fixed-A sets, Asoo 
Ano A etc. For the theory of sampling from a bivariate universe, a very important result 
is an immediate consequence of the fact that the universe of the unit sample distribution is 
infinite, ie. that we may regard the replacement condition as valid. Тһе pooled mean value 
of the B-score associated with any A-score present in the subset is the same for any fixed-A set 
as for the unit sample distribution referable to all permissible values of A. This follows from 
the way in which we weight the samples in conformity with the principle of equipartition of 
opportunity implicit in the chessboard procedure; but the student may find it instructive to 
check the rule by recourse to the 2-fold or 3-fold sample distribution of our 2-face card pack 
model as below. 

For the unit sample distribution we derive the mean B-score (М, . ») associated with x, = 2 
as follows : 


Ф) + (2) + (3) _ g-+2r+3s 


М.а qtrts qtrt+s 


(i) 


For the fixed-A set Ау, we have 6 different types of sample structure of which one with frequency 
брот is 


Within this sample the value of М». з is (1) + (2) = $. The sample itself consists of equal 
numbers of paired scores (1.1), (2.1), (2.2), with a total frequency of 6pgr as stated, whence 
the frequency of paired scores having the relevant values x, = 2 and x, = 1 or 2 is 4fgr, 
and this, divided by the total of such, must be our sample weight, when we pool the values 
of М,., for the whole set. We then summarise the computation of М. з for the entire set 
liso as follows : 
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FIXED A-SET 
HISTOGRAM FOR 2 FOLD SAMPLE 


HH НН Hi 


2ps 2г5 2st 


HH Ed НЕ 


2pF 24 art 


EH E E EH ER ER 


p> apt 2pq cq 2 T 
A200 Аы Ano Aozo Aon Aooz 


Fie. 120. 
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FIXED A-SET 
HISTOGRAM FOR 3-FOLD 
SAMPLE 


БЕЗНЕН 


[^] 
2 
ъ 


E 


6prs 6rst 
6pqs 6qst 
6qrt 


ШЕ 


2 qo ШОШ 
EE Ер 


0 зба 3ft 3р б6р Spt” 3d з © 
Asoo — Azo Ао ^no An Ао» Aoso Aoz Aor Aoos 
p *3pleres) e3pt  -3pqeras? =6ptqerss) — =3pt? (гє Занг). -3q4res) ЕУ 


Fic. 121. 


"BH ЧЕНИНЕН 
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Sample Sample Total 
Structure Frequency M.: Frequency of (2.x,) 

(11).(21).22) — бр 1 4pqr 
(1.1) . (2.1) . (2.3) pgs 2 pgs 
(1.1). (2.2) . (2.3) prs i Aprs 
(1.1). (2.1) . (2.1) 3pg* 1 2pg* 
(1.1). (2.2) . (2:2) apr 2 Орт? 
(1.1). (2.3). (2.3) 3ps? 3 2pst 


The total of the last column in the above is 
2p(s? + r? + 4° + 2rs + 24 + 2gr) = 2p(s + r + 9). 
The total of the products of the last two columns is 
Spqs + 10prs + брот + 2рд° + Apr? + 6ps? = 2p(4qs + Srs + Зат + 9° + 2r* + 3s?) 
= 2p(s + r + 4) (9 + 2r + Зх). 
Whence the mean value of М», з for the entire set А, is 
2p(s--r4-q(g--2r--3s)) (9 4- 27 +- 35) 
2p(s +r + 9)? s+r+g ` 
This identity arises from a more general relation inherent in our visualisation of sampling 
in a bivariate universe as equivalent to sampling independently with replacement from a universe 
of unit grids in accordance with the chessboard principle. The principle of the fixed set, as we 
may call it, is that the distribution of B-scores for a particular value of the A-score is the same 


in any fixed-A set and hence in the universe itself. One illustration will suffice to make this 
clear. From Fig. 121 we see that the B-scores for x, = 2 in the set Apo: is 


Xy. 2 Weighted frequency 

1 (0 + 29st + 2grt 4- 0 + 0 + 2g*t) + 2t(r +g + 5) = 9. 

2 (rst + 0 + 2grt + 0 + 2r*t +0) + 2t(r +g + з) = ғ. 

3 (2rst + 2gst + 0 + 2s°t + 0 4-0) + 2t(r +g + 8) =з. 
In the notation of our club-sandwich universe of all samples the principle of the fixed set is the 
formal identity M,.a = M,.,,; and its derivation follows directly from the initial assumptions 
and definitions of symbols. Our hypothesis is that an observed B-score (x;.,) has two additive 
components : the true value (M, . „), being the long-run mean of repeated observations referable 
to a fixed A-score, and a random error (e,. ac) independent thereof, so that 

хь. = М». + є. and My. acs = Ex) = Mi. a + М,.ас 
If we here conceive each stratum of our stratified universe to accommodate a sufficiently large 
number of experiments referable to the same set of A-scores, we presume that negative and 
positive errors cancel, i.e. 
E,. Ee...) = 0 = ELM.. ac), 
^ Mn as = E{Mp. acs) = Ms a + EdMe.ac) = М.о 

The model of Fig. 118 is consistent with linear regression if we put д = s in the u.s.d.; but it 
does not embody 2 essential properties of the Gaussian bivariate universe as defined in 17.00, 
viz. : (a) homoscedasticity or equal variance of B-scores for any fixed value of the A-score ; (b) 
distribution of errors (i.e. deviations from column means) about zero mean for each fixed value 
of the A-score. To satisfy either condition we must have at least 2 non-zero cell entries in each 
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column of the universe grid, since the column variance will be zero if there is only one non-zero 
entry therein. "The arrangement below shows how it is possible to satisfy both conditions, while 
still leaving two corner cells empty : 


(2р + 84 + 20) = 1. 


_, а 4-H 9) 
hu = ti r= pr n- 3 p 


If the bivariate universe is homoscedastic as for the grid last shown, the principle of the fixed- 
A set carries an important consequence. Since the distribution of B-scores for a particular value 
of A is the same in any fixed-A set, the variance of the B-scores for a particular value of A is 
the same in each fixed-A set and hence the same as in the universe. Hence each fixed-A set is also 
homoscedastic if the universe itself is homoscedastic both with respect to B-scores and to their error 
components. For a particular value of the A-score the error variance is, of course, equivalent to 
the B-score variance, since the two distributions differ with respect to the mean only. Thus the 
error variance of a fixed-A set as a whole, or for a particular A-score of the fixed-A set is that 
(c2) of the whole universe. 

The principle of the fixed- set invites us to visualise the complete distribution of r-fold 
samples from a bivariate universe by conceiving it as a 3-dimensional stratified grid. Each 
layer specifies a particular type of sample structure in conformity with the assumption that the 
sample consists of any combination of r paired scores not necessarily different. Each stratum 
consists of all layers of a fixed-A set and of no others. Within the stratum the number of identical 
layers tallies with the relative frequencies of the corresponding types of sample. Within the 
universal grid consisting of strata corresponding to every possible fixed-A set, the strata repeat 
themselves, the numbers of strata of one or other type being proportional to the frequency of 
the corresponding fixed-A set in the sample distribution. Having weighted our layers and strata 
in this way, it follows that each paired score occurs in the universal grid in the same proportion 
as in the unit sample distribution, whence any parameter of the whole grid is equivalent to the 
corresponding parameter of the 1.5.d. 

Having so conceived the universe of the r-fold sample, we may label parameters referred 
to below with due regard to the conclusions stated above, viz.: (a) that the border A-score 
distribution of all layers in a stratum is the same ; (Б) that the mean B-score for a particular 
value of the A-score is the same for the whole stratum as for the universe. 


Stratum 
Layer (sample) (fixed-A set) Universe 

Mean B-score . Su ae M... M, 
Mean for fixed-A set . Mp „aos My. a= My.a Mira MS Las 
Variance of B-score 

distribution . cl 75 Recs сё 
Mean A-score . MM, ga Mrs M, oM. M, 
Variance of A-score 

distribution . UE ec Көз Vm Vs sen oi 
Covariance . . Соо (£a. cs o.e) Соо (X2. 5.9) Cov (Xa, ху) 


Regression Coefficient . kra. cs Roa. s Roa 
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In this set-up we can visualise the layers as frequency grids of a columns and b rows or as 
score grids of 2 columns, one for A-scores and one for B-scores paired row by row as in a com- 
puting schema (see schemata at the end of 11.01). For the present, we shall adopt the former 
convention, defining a sequence of operations in accordance with the conventions of 11.06 as 
follows : 


Within For all values of A-score For fixed values of A-score 
Column . 3 š Barc anion) Tice) 
Layer . - - E,. Ey. a(---) Ду ee] 
Stratum . d Я Е.Е. By. oss) = Жейу +.) 
ЖЕШ ЧЕ: чы) 
Whole Grid . : B,.E,. E,. E. q(...) = E Booby Дд...) 


The order of operations is not interchangeable, except as indicated. Otherwise, the symbol 
E, would be ambiguous, if we employed it in operations which we might otherwise distinguish 
as E, referable to all A-scores and E, referable to a sample or a fixed-A set. Without ambiguity 
we can drop the subscripts c and s in the symbol хь. „ for the B-score associated with a fixed 
A-score or in the error components defined below: but we must distinguish between 
X, = (x, — Ma) and Xa. s = (x, — Ma. ‚) in virtue of the fact that the mean sample A-score 
M,.,,— M,., being that of the fixed-A set, is not the same as the universe mean 
M, = E(M,.;). With this convention, and with due regard to the fact that E, in the prescribed 
order is a within-layer or within-stratum operation, 
ЕХ...) = Ех, — Ma. s) = Ma. s — Mas =0 . . . (й) 
E(X.) = E(x, — Ma) = M,.,—M, . : : Y . (ш) 
In conceiving a universe stratified in this way, our end in view is to explore the consequences 
of a linear law relating the B-score means to the A-scores, i.e. linear regression of the B-score 
on the A-score. In doing so, we can take advantage of the assumptions inherent in the formula- 
tion of such a law, as stated in 17.00. That is to say, our B-scores have 2 additive independent 
components, the distribution of the error component about zero mean being the same for every 


A-score in any sub-universe specified by a fixed-A set. When there is perfect linear regression 
in the stratified universe so conceived, we imply that 


Му..— My = ky- Xa and M, a= Myt Ra X ыс () 


If we express a physical law in linear form, M,_, in the above is the true value from which an 
observed B-score (хь. a) deviates on account of instrumental error or imperfect control. Accord- 
ingly, we define our errors by the relations 


En. a = Xa. a — My, a = Xy, a — My — (8, — М.) . c 4 (v) 
Xo. a = є›.а + My. a = е.а + My + Р(х, — Ma) . ` - (vi) 
In conformity with this notation, we denote the mean sample error for a particular A-score as 
М, . acs = Ey. a(€v-0) = Mo. acs — kra. Xa — My; 
M,.,, = Е(М,. acs) = Mo. as — hy, X, — My = (М.а — M) — Broa. Xo, 
SUM; ый rand Age, о МОКЕ Ж 
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Whence we may also write 
V(M,. acs) = Ed Me. acs — Me.as)* = ELM è. acs) = V(Mo.acs) - - (viii) 


That M,.,,— 0 is implicit in the assumption that errors are distributed with zero mean 
independently of the A-scores and hence of the true score values (M,.,). Whence, of course, 
follows the identity 


M,.,,—0 : : - 3 5 . (ix) 
From the definition of M,.,,, above we might also write 
My. cs = ЕМ, а) = Mya — ЊМ... М) – М - - . w 
Ed Ms. c) = М,.,=0= M,,—M,— k(M,.,—M) - -. + (x) 
My.as— My.e=Foa.-Xa., and My.,— My = RM... — Ma) - (ш) 


*** Alternatively we have : 
EM, . as) = 0 = E(M,, as) — к. ЕХ) — M, 


—(M,.,— My) — АМ. s — Ma). 
From (xi) we have 
М,.„— M,.,— М,. = Ms. 7 Ms. » 


VOM, o) = ELM a) =V My) . = + © «© (i) 
If the sample contains p paired scores, the expression on the left of (xiii) is the variance of the complete 


distribution of the mean of a p-fold sample of errors, being the same for every sub-universe referable 
to a fixed-A set. If therefore o7 is the variance of the error u.s.d. 
2 
9e 


Ү(М,. cs) = > = WM.) . . . . ‚ (xiv) 


Since our assumption in conceiving a law as a description of such a universe is that the errors, 
being independent of the true value, have the same random-wise distribution about zero mean for every 
fixed value of A, we may write V,,, = оў = M(V,,,). This relation makes explicit the implication 
that the universe is homoscedastic in the B-dimension, since 


И... = E,. E, . Ey (ху. — М.а) = У.а 
os Vi. а сМ): : . . А . : » (zy) 


By reshuffling our grid cells, so that all B-scores referable to a fixed A-score constitute a column of a 
2-dimensional lay-out, we can make explicit the tautology 


оў = M(V,. a) + V(M, . a) = o? + V(M, a). 
When regression is linear 


05) = 00.0 
We have thus split our total B-score variance into 2 additive components, 
(i) that of the hypothetical true values we seek to estimate : 


ИМ,.)= Фе. o 2 0. 0. 0 0 бм) 
(ii) that of the errors we make in attempting to do so : 
оў = (1 — rh )og д Е à à с . (xvii) 


*** We shall require (xiii)-(xix) at a later stage; but the reader may prefer to go straight to the derivation of 
(xx)-(xxvi) and return to the section between asterisks thereafter. 
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Within a stratum the error variance for a single value of the A-score is 
Ve, as = Es - En (t a — Me. as)” 
In this expression, as in the derivation of (vi) : 
€v, a — М,. as = (хь. а — Roa + Xa — М) — (Mp. as — Poa» Xa — M) 
= (n.a М. as), 
e Kosas = Vos . B . E . : E : - (xviii) 


By a 2-dimensional lay-out of the errors referable to fixed A-score values within the stratum, we 
derive the tautology 


V,.,— М(У,. as) + V(M. . а). 
In this expression, V(M, , as) = 0, since M, , as = 0 from (vii) above, so that 
Ve. a = MV... as). 


Whence from (xviii) 
Va. s = M(V,. as). 


Now the distribution of errors is the same for all sub-universes, being independent of the A-scores, 
whence V,,, = оў. 
MV, . as) = 0f = E (Vraa) 0. + + o (xix) 


*** Within a stratum or within a sample (layer) we may postulate for algebraic convenience 
hypothetical regression scores which conform to the tautologies specified in 11.04, viz. : 


ж„.аа== Mo. s + kra. s. Xa. and &r. acs = Mo. cs + kra. os: Ха. s ‚ (xx) 
In these expressions the definitions of kya. , and kra. cs are implicit, as indicated in 11.04, vis. : 


Cov (Zano) ong hon Cov (Xa. os Xo. es) 


Beet EA Cem 


In virtue of the identity of A-score distributions in each layer of the stratum, Va. es = Va + 
and 


(xxi) 


ENTERS 
NUES г In 


(xxii) 
If we label our coefficients appropriately, we may adapt a tautology of correlation set forth in 
11.04 without danger of confusion, viz. : 
Tap. = Kia On 
Pan so Voca = а.а. Va. and riu 00+ Р. ва m ьа. ва: Vaia . (xxiii) 


By making use of the identities Va. es = Va. s and My. as = Ms. a we can establish the 

two following conclusions : 

(i) Within the stratum, the mean value of kya. сз is Roa. s i.e. for а fixed-A set kya. cs is 
the unbiased estimate of kpa., This follows at once from (xxii) of 11.08, which 
exhibits the covariance of the pooled sample paired scores as the mean value of the 
covariances of those of the sub-sample when the border A-score distribution is the 
same for all sub-samples as we here predicate of the stratum. Within the stratum we 
may thus write 

Е, Cov (Xa. ess Хь. ов) = Cov (Xa. s Xo. s). 
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Within the stratum V,.,; = V,., is constant from layer to layer, so that 


Соб (x5. ә %. 6s) Соо (Ha. в» ®ъ. ое) 


[m Къа. os SR Я 
Е{Кьа. са) = Ce ch. = kya.s ; * . (xxiv) 


(ii) The value of &j,., is the same in all strata, i.e. for the complete sampling distribution 
of any fixed-A set. By (xii) above (M,.,, — Мь.,) = Аа. Xa.s Whence from 
(xi) of 11.02: 


Cov (£a. sy хь.) = Ey  Ea( Ma. as — М.) (х — М...) = kva Ee. Е(х„ — Ма.) 
^. Cov (ха. Xo.) = koa. Va.» 
Cov (Xa. s хь.) 


ve Къа = Ves y QAM МЕ чүш 
"This result permits us to interpret (xxiv) in the form 
ЕК, оа) = Ryo . . . . (xxvi) 


This means that the mean of all samples of ksa. cs in the "Y set is the true regression 
coefficient. We express this by saying that the sample statistic which is an unbiased estimate 
of the true regression coefficient (ksa) of the parent universe is the ratio of the sample covariance 
to the sample variance of the A-score distribution. 

If we assume what is rarely true (p. 714) of A-score sampling in experimental work, i.e. that our 
sample of A-scores is random, we can now derive the unbiased estimate of the true covari- 
ance. For random samples of p paired scores we may write 

E, EV sed) = EWV. ) =? ob 


From (xxv) above 
Cov (хц. » хь.) = Fia s. Va. s = koa Vaso 


+. E, Cov (xa. „ 3), a) = КЕДИ.) = 1 ой. К 


(p — 1) Cow (Xa, хь) 

ME ID C >> 

(P — 1) Ст (s, а) 
P2 


In sampling at random w.r.t. the A-score, the unbiased estimate of the covariance is therefore 


wv. E, Cov (Xa. » хь.) = 


7. E, E, Cov (Xa. ex Х.е) = 


р Со (Xa. cs X». cs) 57 (хо — Ma. es) (х — М. cs) 
(2—1) fei (p—1) 
In what follows, we shall need to derive an estimate of the B-score variance of the stratum, 
which we may define by recourse to a 2-dimensional rearrangement of the cells in columns 
referable to a fixed A-score as 


(xxvii) 


Vy, = M(V s. as) + ИМ. as) 
= M(V5. as) + Kia. s- Vas 
= M(V,.) + В. V av 
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Hence from (xix) above 
Wyse Vso - Я ` : . (xxviii) 


If we re-arrange the cells of the stratum, so that all B-scores of the same layer lie in one column 
of a 2-dimensional grid, 


V,., = M(Vo. cs) + (М. cs) = ELV». cs) + (М.а). 
Whence from (xxviii) and (xiv), we derive 


о. Vas = ду 9+9, 
ES BAV у= 204+... b= Miser as fol best ЕЕ} 


It is implicit in the fundamental principle of the fixed-A set (M,. as = My. a) that regression 
is strictly linear within the sub-universe, if also strictly linear in the stratified universe as a whole, 
and the left hand side of (xii) makes this explicit, viz. : 


My.as— My. s = kra Xa.» 


Accordingly, we can alternatively define our errors in terms of deviations from the stratum 
regression line or from that of the universe as a whole in either of two ways : 


€). a = Xy. a — My. a = Xa — Каха — Ma) — My = Sv. a — К.Х. — My; 
€). a = 3X). a — My. as = Xia — Ка — Ma. a) — My. s = Xp. a — RoaXa.s— My. , (xxx) 
These alternatives are consistent, since they imply the relation on the right of (xii), namely 
M,. ТУ. м, ES к(М,. ALS а). 


17.02 COMPUTATION FOR THE REGRESSION EQUATION 


In 17.00 we have defined the practical problem of determining the best value of the physical 
constant of a law expressible in linear form as that of estimating the true value of a regression 
constant in a universe of which we can predicate exact linear regression. We have now seen 
that the sample value which is in fact such an unbiased estimate is 


һ..„= безас MR s 


To say this does not mean that the sample value M, . acs of the mean B-score for a fixed A-score 
will fall exactly on the line whose slope is ksa. es. Our confidence in the law merely expresses 
the anticipation that observed values of the B-score means for fixed A-scores in a particular 
experiment will cluster closely around the line of slope ksa. <s passing through the sample mean 
B-scores (M,.,;) and A-scores (M, . ,,). 

To keep our feet on the ground we may here pause to consider the use of (i) to determine 
the elastic coefficient (k,,) of Hooke's law cited illustratively in 17.00 above. 

Example. Тһе data of a class experiment are as below. 


Load (grams) Mean stretch (mm.) 
Xi Xs 
1 0-4 
2 11 
3 14 
4 2-1 
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To find the elastic constant we proceed as follows : 
М.=014+2+3+ 4 = 25; 
М, = 04 + 11 + 14 + 21) = 1:25; 
V, = 01+ 449+ 16) — (25)? = 1:25; 
V,— 0:4 + 1-1? + 1-4? + 2-1?) — (1-25)? = 0:3725; 


(Goa?) аш) i 34) + 421) _ (59.5) = 0.675 
ku = s = 054. 


In accordance with the notation we have used elsewhere (11.04 and 17.01), we may now 
formulate the regression equation which expresses the relation between the load (x;) and the 
hypothetical regression score (x,.;) which is our estimate of the corresponding stretch, 


х,..— M, ha — M) or х„,=Ёш.х +С. . = (ii) 
The value of the constant definitive of the origin in (ii) is 
C—M,—k,4. M. 


In this case 

C = 1:25 — 0:54(2:5) = 0-10. 
The observed values and so-called predicted (i.e. assigned) values, i.e. values calculated in 
accordance with (i) and (ii) in agreement with what physicists call the least square method 
would thus be 


Observed 04 11 14 24 
Predicted 0:44 0-98 152 2-06 
In this example the variance of the regression score distribution is 
0-675)? 
а.и, = on = 0-3644. 
As a fraction of the variance of the distribution of stretch scores this is 
0-3644 
03725 098. 


We may thus say that a linear law here accounts for 98 per cent. of the variance of the stretch 
score distribution. 


In the notation of 17.01 the regression equation expressing the so-called predicted value 
(x,.q) of a B-score for an A-score is 

Kya = Ва.ев+ Xa d С; C= My.ca—Roa.cs»Ma.s - . . (i) 

It is important to distinguish the above from the exact relation connecting the observed 


B-score (хь) with the A-score. The appropriate equation which expresses it involves the true 
value of the regression coefficient and an error term, viz. : 


Xa = kya e Xa + Cd xe; C= Mi. s — kia. М, К à . (iv) 
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For speedy computation of ksa. cs we may proceed as follows for p paired values : 


Jap ia 
Xxo-&-RMG Уа-а 2...) 
j-1 j=l 
qu TEF. i ^ 
Dna P М 80 = i + . . + (vi) 
j=l j=1 
je sa 
о 4 7, à 5 E (vii) 
j=l 
In this notation 
5 Sasi 
Ст( m) =P I 
T fs 
oL RECS 


Whence in (iii) above 


(viii) 
1 : 
C = - (Sa — Roa. cs- Sa) + é А Е v 6x) 
P 
The computation sheet will thus require five columns : 
% хь x | a Eo. f 
Totals Sa ET | Saa Sov Sav 


17.08 UNBIASED ESTIMATES OF REGRESSION PARAMETERS 


Having established the conclusion that the ratio of the sample covariance of the bivariate dis- 
tribution to the sample variance of the A-score distribution is an unbiased estimate of the slope 
constant (regression coefficient) if the mean B-score of the u.s.d. is a linear function of the A-score, 
we have as yet no criterion of the sampling error of the regression coefficient nor of the sampling 
error of a B-score estimate based on its sample value ; and we have still to justifiy our confidence 
that the true law of the universe is linear when a sample of paired scores furnishes us with the 
only available precise information about its structure. 

Before attempting to answer the questions implicit in the last two sentences, we may with 
advantage retrace our steps to the significance test for the correlation ratio in 16.08. This test 
purports to answer the question : have we good reason for believing that there is a law asserting 
the dependence of the B-score on the A-score ? When they take the next step by asking whether 
the form of the law is linear, exponents of Fisher’s test procedures follow the same path 
inasmuch as they seek to define what different estimates of the variance of the B-score distribu- 
tion or that of its error components must be consistent, if the null hypothesis is correct. 

Since the significance tests which we shall now examine lean heavily on those developed in 
Chapter 16 in connexion with the Analysis of Variance, it is helpful to view the sample structure 
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as a score-grid on all fours with the customary schema of 2 columns and р rows for p paired score 
values. Accordingly, we recall the illustration (p. 431) at the end of 11.01. Below is a 
symmetrical frequency grid exhibiting 16 paired scores in the range 1 to 4. We shall also lay it 
out as a score-grid (‘Table 1). 


A-score 
1 2 3 4 Total Sum Mean 
1 1 1 2 3 i 
2 1 8 2 6 13 12 
3 2 3 1 6 17 E 
B-score 
4 1 2 7 ы 
"Total 2 6 2 16 40 H 
Sum 3 13 7 40 
Mean H Г 12 E H 


"The alternative lay-out calls for a modification of our notation exhibited in the accompanying 
score-grid on the assumption that our concern is with the regression of the B-score on the A-score. 
We then need to distinguish one A-score (а;) from another in virtue of its numerical value only, 
indicated by the rank subscript 7, but we need also to distinguish B-scores (b,.;) associated 
with the same value of the A-score and label them with a double subscript accordingly. 
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TABLE 1 
For fixed value of A-score 
A-score (а) B-score (b;.,) 
'Total of B-scores No. of B-scores 
(Т,.) [2 
a, =1 + Е ize 
È ь..=т..=3 ъ=? 
b.l-2 j=l 
bi.2=1 
bye 2 
bs. =2 j= 6 
У ы..=Т,..=13 = 6 
j= 
bs.2=3 
bps =3 
bi. =2 
bz. = 2 
.=3 3-6 
2 ы..=Т.3=17 = 6 
аз [PLE j=l 
а= bs. = 3 
а= 3 bes =4 
a=4 bac =? 
LL—— ——À > ю®а=1а=7 B2 
a, —4 bi = j=1 
i=4 
p= 2 5-1 
i=l 


In the accompanying schema we introduce no conventions to distinguish sample stratum 
(fixed-A set) or universe (whole 3-dimensional grid) parameters. Where necessary we can do 
this as in 17.01, e.g. for mean B-scores associated with the fixed A-score a; we may write M, .;,,, 
My. is) My; For the present, this need not concern us. It will suffice to write 


lice 1725 
I S pais Mme 95 #5 
EC Pi jai 
ime јери 1& 


SEE PE Myas 


5j ici 
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j-2, 
ERI у (ШМ у= E (0. M)? — (M.,— Му; 
Pi f Pi jai 
1 уге»; 
"кле; > Bic y > = (b;. =mi X P(M,.,— Ma)? 
i=1 i=1j= P 
= V, — ИМ. 0); 


Cov (а, b.) = = 55 Pda: — М.(Мь., — My). 


i=l 


When we employ this notation henceforth, we shall write (a; — M,) = А, so that 


I 


2 pi. A;=0 and >= АИ . К є eH) 
1 
Cov (а, bi.) = = D» bie A(My.4— М) . . . . ii) 


In what follows, we shall need to recall an important property of covariances, viz. that 


M, iz: 
Cov (a; һ.9=5 > Bi А.М. = D Р.А 


2d i=1 
aU gp IDIOT ас mee (Ш) 
Pp i=l 
Within the fixed-A set, A;. , has the meaning (a; — M,.,). We may therefore write 
i-e ime 
Pi- А... Mo. ies Pi- А... Mois 
Ryo. os = LU d А. = = kim 
ba. са 2 Ф УЙДЕ; n b PA TUR Й 
^ (Rea.cs — lap. Va.s= У Ра. Ai (Moie Mo.) + (iv) 
i=1 
Whence from (vii) of 17.01 
й=с 
(koa. os — Roa)P - Va. s = > Pbi Ay. a» My. ies : . . (9) 
i=l 


So long as we restrict our attention to the fixed-A set, we view the sampling process through 
the spectacles of Churchill Eisenhart's Model I in 13.04. That is to say, we conceive our sample 
as one of an endless repetition of experiments done in the same way. In the idiom of 17.01, our 
bivariate universe is thus a stratum with all possible values of the B-score distribution for a 
fixed-A set ; and the student must therefore lay aside preoccupations suggested by any previous 
acquaintance with the so-called bivariate normal universe. With more or less propriety, we may 
assume an approximately normal distribution of the B-scores for any fixed value of 4; but 
the distribution of the A-scores will rarely be approximately normal—and indeed calls for no 
explicit specification—in the infinite succession of similar experiments among which our actual 
sample constitutes a single act of repetition. Throughout what follows, as in later sections of 
this chapter, we therefore assume consistently that the relevant framework of repetition is a fixed- 
A set which may have any distribution involving at least 3 different A-score values. ‘This assump- 
tion is unnecessary only when kj, = 0 = rq in the universe asa whole. In effect, we then sample 
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within the stratum of the universe of 17.01. On this understanding, it will be convenient to 
write 


C,— LH so that CARLA y s TER 
P. a-s (> bi Ay 
i=l 
Whence from (i) 
ize i-e 
È 06-0 and у= $ С н 20. (i) 
i=l "Ра. в i=l > pA? 
i= 
We may now rewrite (v) as А 
(Б. Fea) = р СМ ш) 


i=l 
Our next step is sufficiently important to justify a digression. Suppose that the player’s 
score (x) at a single trial is the sum of some fixed multiple (C,) of each score (x;) recorded by 
one of a set of р lottery wheels, as in the Orthogonal Lottery Model of Chapter 12, i.e. 


х= Cu + Cos Cu... Coty. 


If the variance of the player's distribution is V, and that of the score distributions of the 
ith wheel V, 
V, = СЇЎ, + CSV; + CVn... + C3V,. 


If the score distributions of the wheels are identical, we may write o2 = V, = V, . . . = V,and 


ИСС... +0) = S C. 
m-1 
Furthermore, we may suppose that only c of the p values of C,, are different, and there are p; 
identical values of C;, so that 


V.— o6 2. р. С? 
i=l 
Instead of recording as his score the weighted sum of single trials of the p wheels, we may 
vary the rule of the game so that the player records as his unit score the mean of spinning p; 
times each wheel to which we assign the particular weight C; The variance of the mean score 
distribution for each such wheel is then (o7 + р) and 


ime а? d-c 
„=> оС. (ix) 
ie Pi Pel 


Now the hypothesis we are exploring as stated in 17.00 is that the errors associated with any 
value of the A-score are independent of one another and of the value of the -score itself, the 
mean error-score (7M, . șes) whose expected value is zero is therefore independent of the A-scores, 
which occur with the same frequency from sample to sample within the fixed-A set. Within 
the fixed-A set the variance (o; ,) of the distribution (kya. cs — koa), or of kpa. es since change 
of origin does not affect the variance, is thus an expression of the same form as (ix) in which 
(о2 + р) takes the place of the true variance of the mean error (o2—- р), i.e. 


= > uA У C. 
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Whence from (vii) above : 


" ol 
re wc m CT. ae (x) 
DP. Ai 
i=l 


If we now make the assumption that the error distribution is normal, whence that of the 
mean of a p-fold sample is а normal variate, the principle of the fixed-A set implies that 
(kna. es — Roa) as defined by (viii) is a sum of independent normal variates and is itself therefore 
a normal variate with zero mean, since kj, is the mean value of kpa.cs Thus we may define 
a normal square standard score (Chi-Square variate of 1 d.f.) by the ratio 


А быз» = fib Foo 
t. “2 


TThe error variance (o2) is, of course, the expected mean square deviation of the B-score 
from its true mean value defined by the relation Ms. = К.Х. + My. All our sample tells 
us is the deviation of the B-score from the hypothetical regression score 


Xr. a = koa. се Ха. + Му. 


To get an unbiased estimate of o2, we therefore examine the implications of the tautology 
of (xxi) in 11.04. In the notation of 17.01, this is 


EEn. (y a — е.а) = Vo. es — Fia a Vas = (1 — a.a) V.o - (xii) 


Within the fixed-A set, V, ., is a constant. Thus the expected value of the mean square deviation 
of the B-score from the sample regression line within the fixed-A set is 


ELV». а) — Vo. Eh)" 


(xi) 


By (xxix) of 17.01, this is 

x uF a i ee) oes oo Өй 
Now by definition, 

Eis. es — kna)? = о, = Еа. c)? — Fio 


k. 
ү. ЕР. eua) Va. = O.a Va. s + Fs Vas. 


Whence (xiii) becomes 


Also from (x) this is 


o2 . а E б (хіу) 
We may thus define a statistic whose expected value is оу by the relations 
dii E ama r.oet and B= d. . (0) 


Alternatively, we may write 
О... 
р 2 


9 = (xvi) 
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Our unbiased estimate of the variance of the distribution of the regression coefficient is then 


_(1—725..) Р.о 


t= DV, 


If the number (р) of paired sample scores is large enough, we have now the materials to 
supply an answer to two questions : (а) what are the implications of the hypothesis that there 
is zero linear regression ; (5) what we may rightly say if samples from different universes are 
consistent with the assumption that there is the same increment of the B-score per unit increment 
of the A-score in each. For a reason we shall discuss later more fully, (а) does not mean the 
same thing as saying that there is no law connecting the two sets of scores. Here it suffices 
to remark that the assumption of linear regression is explicit or implicit in (а) and (b), and 
our justification for this presupposes the existence of a test for linearity. 

From (xi), (xii) and (xvi) we may define the ratio of a square normal score with zero mean 
to the unbiased estimate of its variance by 


(P — 2) (Roa. cs — Ta)! Va. s 
CS IV. es 

We may regard this as an approximate c-ratio if the sample is large. To make use of it, we 

need to know the value of k,,. Ordinarily we do not know this; but zero covariance implies 

that таъ = 0 = kya. If so, (xviii) reduces to 


(2 — 2). „Уа. (р — Drane 
(таа) Реа (таа) 
"Thus the normal integral gives the approximate probability that the expression on the right 


of (xviii) will be equal to or greater than its sample value on the assumption that ky, = 0 = ray; 
and this is therefore a significance test alike for zero covariance or zero value of kya. 


(xvii) 


Е, (xviii) 


F, 


(xix) 


What is of more interest is the possibility of testing the significance of a difference between two 
regression coefficients when covariance is not zero. We shall exhibit Fisher’s test later; but 
we may here pause to interpret (xviii) as a basis for an approximate c-test in the same 
framework of assumptions when the size of each sample is large. If we have two large 
independent samples of paired scores, one p-fold and one g-fold, we may use the normal 
integral to test the assumption that the difference between the two sample values (kya, p 
and kya. a) Of Aya, сз is statistically trivial. The null hypothesis is then that the common 
universe value of the regression coefficient is k,,, so that the difference is 


Fia з — Roa. a = doa = (Ба. p — koa) — (koa .a — Roa) - : - (X) 


This being the difference between two independent normal variates is itself a normal variate 
with sampling variance which we may write without ambiguity as 


$ : 
SE. = 90.5 + о 


With analogous conventions for sample parameters, our estimate of of, pg will therefore be 


(1— r.p) Vi. | (1— ri. Vo. з 
TAL I £0, s E «(xxi 
Ma Wa сш ; 
Our approximate critical ratio for the difference test will therefore be 
„= QM. ws ny 


Sk. pa 
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QUADRATIC REGRESSION IN A BIVARIATE UNIVERSE 
(Sampling with replacement) 


The approximate test defined by (xix) involves the ratio of two complementary fractions 
of the variance of the B-score distribution, viz. 75. V, and (1 — 73,)V,. Significance tests pre- 
scribed by Fisher's school involve the derivation of certain relations relevant to other partitions 
of the variance of the B-score distribution. We have already examined one such in 16.08, where 
we exhibited a significance test for the correlation ratio (эш). If the result of the latter test can 
show that the correlation ratio does not differ significantly from zero, there is, of course, no 
need to ask whether the product-moment index significantly exceeds zero. We have seen 
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(footnote to 11.04) that 12, must be greater than 72, or equal to it, being equal if regression is 
linear, including the trivial case r2, = 0. If the true value of зї, is greater than that of rô, there 
must be a non-linear relation between the two sets of scores. Fig. 122 shows that a high value 
of 12, is indeed consistent with zero covariance when the B-score means are a quadratic function 
of the A-scores. 

To say that 77, significantly exceeds zero and that 72, does not, thus points to the existence 
of a non-linear dependence of the B-score on the A-score. This gives us the clue to a way of 
testing whether regression is in fact linear. We require to know the distribution of a sample 
statistic which measures the xcess of 12, over 72. To this end we shall first recall (Table 2) 


TABLE 2 
Tautologies of Regression 


Source Parameter 


1, Sampling Error MV». acs) = (1 — ms. es) Ро. ев 
ime je», 


EEr dira- Mesum, D У Ore Mia 


i=1 j=l 


V(M, . ee) — Ka. ea - Va o s = (hazes — Ta nea) Vives 
ime 
1 
EMs. ser е.а) = 5 XT LET 
i=l 


3, Linear Kia cess Va. s = Tåb. es. Vaer 
Regression ic 


Euler ens — My. iD! == >. pfe tes — My e 
P 


4. Influence of V(M,. s - Vh. es 


А оп B = 
EMs ace — My)” = 5 У PMs tes — MUI 
i=l 
5. Error (1 — па. ea) Va. es 
geen je» 
E,Ey ж.а — rid! =} У У 5a-Me.so-hee4)? 
i=l j=l 


6. Total of 1, 2 


and 3, of 1 and 4 ier dim 

id of 3 and 5 1 

И Е,Е,. atsa = М›.д* У У М.а) 
i=l j=1 


as in the accompanying table certain necessary relations between B-scores, hypothetical linear 
regression scores and B-score means already exhibited zs tautologies of the grid in 11.04. The 
column headed source in Table 2 anticipates the statistical interpretation we shall later impose 
on each parameter defined alternatively in the notation of this section and in that of 17.01. 

To make explicit what information about the universe each sample parameter of Table 1 
supplies in terms of the source of variation, we must explore what is its expected value. The 
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hypothesis stated in 17.00 is that each observed B-score has one component, the true value, which 
is a linear function of the A-score, and an independent (error) component (е;. ;) with zero mean. 
"This is on all fours with the consequential relation between the scores of the player and umpire 
in the model set-up of 12.01, where we postulate a relation of the type x, = А.х, + Xa, o 
We may translate our hypothesis into the language of 13.04, if we conceive the true value as a 
regression-factor in the 2 column grid of paired scores, i.e. 


Ев а and Be. ыу. ш у= (Edi) 


The first 6 items of the second column score-grid for the 16 pair set exhibited in Table 1 then 
take the form 


The mean error is zero for any value of the A-score in the complete sample distribution of the 
fixed-A set. Fora fixed value of the A-score within the sample and within the sample distribution 
of the fixed-A set, we may therefore write 


М... = Е, + М,., and My. = Fit М,.,,=Ё, . + (xxiv) 
If the mean stratum value of F; is M,.,, we may therefore write : 
М,.„= М,.,+ Mi. and М.,= М;.,; 
My. ics — My. 4 —(F, — Mg.) + (Me. ics —M,.«) and M,.4 —M,.,—(Fi— М;.,) (xxv) 
In the last expressions, 
Е, — My. = (Roa а + C) — (Roa » Mas + C) = а — Ma.s) = һы. A. 


Thus (xxiv) expresses the relations defined by (xii) in 17.01 in terms of the factor concept of 
13.04. In accordance with our treatment of the Model 1 balance sheet of variance, we shall 
therefore write the variance of the A-B factor distributions : 


ООА vorum HORT ds oos (xl 


The sample value of the B-score variance for a fixed A-score depends only on the error 
component, since the regression-factor is then fixed, ie. Vy. ics = Ё,. ы. If there are f, 
B-scores associated with one and the same value (a,) of the A-score, we may write the expected 
value of V,.,, in the notation of 13.04 as 


—1 
ЕДУ...) = V. 


In the same notation the expected value of the mean variance of ће B-score distribution is 
E,. M(V». ace) = Е,. ЕУ. acs) = ЕЁ. ЕДУ. acs), 


2 Е, MUS ue) = E (P). 
Pbi 
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In this expression | ' 
e (P EX 3 > Pi (8 = *) 1 Sa i p e 


Р: РХ Pi 2a 2 
Duce е 
we Ee» M(Vo. acs) = 5 DN. Р Е А . (xxvii) 
And we may define one statistic which is an unbiased estimate of error variance by 
2 Еа aa m 
g= see and Edi) = 02 . E . (xxviii) 


This explains the denomination of source against (1) in Table 2. We shall need (3) and (4) to 
define (2) and can define (4) in terms of 1 and 5 since 


V(M,. aes) = Vs. a — MV. acs). 
In this expression our Model 1 (fixed-A set) assumption signifies that 
У.а = о; + Vei 


pei 
^ EV.) = 08 +? ot, 
Siva b= zl | 
" E, VMs. ы) = 08 7 dee т oi . (xxix) 


"Thus we may define a statistic whose expected value will be the error variance, if (and only if) 
the row factor is zero : 


2 
в-а Tes and ЕВ)... бә) 


m ze 
This interprets 4 in Table 2, since the expected values of sj, and 52 will be identical only if o? = 0, 
ie. the A-score has no influence on the B-score. "To derive (3) we use the relation employed 
in deriving (xv), viz. : 
ЕДЊ,.„) = оў, + koa 
If regression is linear, we may substitute in accordance with (xxvi) 
А 9 р 

Edas Va) = + о} = Ета. Voes) + + + (xxi) 
On the assumption that regression is linear, we may thus define a statistic with the same essential 
property as s} by the relation 

S—qdaP.V.a and Е) =p . . (endi) 


Hence from (xxx) and (xxxii), and hence subject to the assumption that regression is linear 


c—2 cm 
Ев.» — т.е — 7g o e o (юш) 
Thus we may also define a statistic whose expected value is the error variance by the relations 
а Р.а 3 
$= (Tae "D? Fy. and E,(s2) = о? Я ë (xxxiv) 


We may tabulate these results as in Table 3, which includes the statistic defined by (xxx) above 
and makes explicit the essential assumption in the derivation of the foregoing. 
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17.04 SIGNIFICANCE OF ESTIMATED REGRESSION PARAMETERS 


Table 3 of 17.03 exhibits various sample statistics, one (s) of which is necessarily an unbiased 
estimate of residual variance (of). The expected value of others will necessarily exceed the 
latter unless one or other of certain conditions specified in the column at the extreme right holds 
good. The expected value of the ratio of any one of them to s; will then exceed the expected 
value of the ratio of consistent estimates of variance. We have explored the distribution of 
such a ratio on the assumption that : (a) the score distribution in the parent universe is normal ; 
(b) the two variances are statistically independent. Before we can employ the sample statistics 
of Table 3 as a basis for testing whether one or other prescribed condition does in fact hold good, 
it will therefore be necessary to examine which we can pair off as independent statistics. 

The student who recalls the test for the significance of a correlation ratio in 16.08 will indeed 
recognise in Table 3 of 17.03 two independent estimates whose consistency is a criterion of the 
dependence of the B-score on the A-score, viz. those here denoted 52 and зу. We may denote 
their ratio as 


If (and only if) o? = оў, as when о; = 0, this is the ratio of 2 independent Chi-Square variates 
of (c — 1) and (р — c) degrees of freedom respectively, being therefore a Type VI variate. 
Otherwise, the expected value of 75,.,, will be greater than that of (1 — 55, ,). Ме must 
therefore regard an uncommonly high value of Fmu as: (i) a rarity if we are content to accept 
the null hypothesis that there is no causal nexus involved in the pair score distribution ; (ii) 
alternatively, as ground for dismissing the validity of the null hypothesis. 

Scrutiny of Table 3 invites examination of the properties of two other ratios, one as a 
criterion of zero covariance (ka = 0), the other of linear regression, viz. : 


ПЕРИ Три Е У _ 
(1 — ља.) (1 — maa) `(с—2) 

In connexion with any use we may subsequently make of F,,,, above and of either ratio in 
(xxiv), one property of the denominator calls for comment. If we have only a single B-score 
for each different value of the A-score, the sample variance of each column in the frequency 
grid is zero and M(V,.,,,) = 0. Such a unique relation between A-score and B-score values 
also signifies p = c, so that (p — с) = 0. Thus the statistic s; in Table З is indeterminate, being 
the ratio of two zeros. A desideratum of the three significance tests based on s; and discussed 
below is therefore that there are several non-identical B-scores for at least one value of the 
A-score. 

To get into focus the problems we are now ready to tackle we may with profit recall the 
assumptions of the test based on Ё„„ above as stated in 16.08. There the null hypothesis was 
that each set of B-scores corresponding to a particular A-score is a sample from the same universe 
as the set of B-scores associated with any other value of the A-score. If we look on each column 
of the score grid of 16.08 as a sample from a sub-universe of B-scores, our postulate is therefore 
that each such sub-universe is identical with any other. Formally this means that F; = 0 in 
our equation of B-score build-up, so that 0;.; = є;.; + C. The constant C which is common 
to all B-scores regardless of the meaning attached to ¿ then merely signifies that the B-score 
mean, unlike that of the e-score component, is not (necessarily) zero. If our null hypothesis 
includes the assumption that regression is linear but excludes the assumption that the B-scores 
and A-scores are independent, our model universe is no longer Bernoullian (i.e. homogeneous). 


Res (i) 
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Each column of the grid of 16.08 is then a unique sub-universe. The entire universe of B-scores 
is then a stratified universe. 

To define the commonly prescribed F-test for linearity, and a so-called exact test of 
significance based on (xix) of 17.03 we have to be clear about three things : 


(а) any such test assumes a normal distribution of the error component of the B-scores 
and is more or less exact only in so far as this postulate is more or less correct; —— 

(b) whereas the universe of e-scores is homogeneous by hypothesis, sampling in the universe 
of B-scores is stratified unless the B-scores and A-scores are independent, in which 
case o; = оу, and the issue of linearity does not arise ; 

(c) a Chi-Square variate is the sum of square standard scores of unit variance and as such 
involves the true and unknown value of the appropriate universe parameter which will 
disappear in the variance ratio only if it appears in both the numerator and denominator 
of the latter. 


We cannot legitimately employ the customary formula (o2 = о? — п) for the variance of 
the mean unless we are sampling in a homogeneous universe, in this case the universe of e-scores ; 
and the denominator (1 — 57, „) of Feu in (i) is, for reasons we shall state more explicitly 
at a later stage, a parameter of the e-score distribution alone. Consequently, (c) implies that 
any sample parameters of an F-ratio we invoke within the framework of the assumption that 
B-scores and A-scores are not necessarily independent must be expressible in terms of the e-score 
distribution alone. 

Our next task must therefore be to define in what circumstances it is possible to express the 
sample statistics (7, 4, — 72, „„) in the numerator of Е, as defined by (i) above and s? as defined 
by (xvi) of 17.03 in terms which involve only error components and constants. We first recall 
the tautologies (Table 2) : 


(niae т.а). = ЕМ... — Xr. acs)” = EM. aes — My. es — kra. os- Ха. )* (ii) 
О.У... = Ea. Ey. (х›.„— х,а)? = Ё(х›.„— My. os — Pis. os- Xo. 0)? (iii) 
We shall also need to make use of (vi) and (viii) 17.03, viz. : 


EI 
р. Va. (Ка. cs — Ка) = 2. bi- Ai. My. tes pEEQXS s- М.а). . (іх) 
If regression is linear, My. as = kya- Xa. s + М... Also, in any case 
(М... — Ms. as) = Me.acs and. (Me. cs — My.) =M.. os 
by (vii) and (xi) of 17.01, whence we can write (ii) in the form 
С. — Tia cs) Vo. cs = EM. ass — Mo. as) — (Mo . es — Mo. a) — (Roa. cs — Ria) Xa: a" 
= E(M,. acs — Me. о) — (kra. cs — kra)Xa. 6)” 
= EM; ы) + (М? „) + (koa. os — koa) Va. « 
— 2M.. es  E(M,. acs) 
+ 2M.. eskoa. cs — Ња). ЕХ.) 
— (ksa. os — Roa) EX... Me. acs). 
In this expression E,(M,. acs) = Me. es and E,(X,..) = 0, whence from (iv) 
(паа — 6.) РЬ. „= (Му aes) — Mia — (koa ea — Roa) Vas <. (у) 
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We may write this alternatively as 


(nha n — Toa.ce)P + Vo. es В.М. р. М. (а. се — koa) P Va. s 
i=1 


о; 7 5 в 
Since our universe of e-score components is homogeneous, we may write the variances of the 
mean e-score for a sample of p; associated with a fixed value of the A-score, and for a p-fold 


sample associated with all the A-scores of the fixed set, respectively as 


o о? 
оё; E and oi E" 
Whence the foregoing expression becomes 
(та. = Tia. co) - Vr. os Е Мы м (bna es — һы)р Vas А . (vi) 
9, Л) Om 9, 


Since the true mean of the errors for a fixed value of the A-score or for any fixed-A set 
as a whole is zero, the first term on the right is the true variance of the e-score means for a fixed 
A-score being therefore a Chi-Square variate of c degrees of freedom. The second is a Chi- 
Square variate of 1 d.f. and the third is, being as already shown a square standard normal score, 
also a Chi-Square variate of 1 d.f. If we can make the appropriate orthogonal transformation to 
express the second and third terms of (vi) as Chi-Square variates of 1 d.f. included in the first, 
the expression on the left is therefore a Chi-Square variate of (c — 2) d.f. What follows is an 
outline of the proof. We first put, as in 16-02 and 16:04 : 


S Pie Miia S a. Y ML. 5 
А-А o 0" 


= C.M. 5 Ур. Cy. Mies 


i-i Tmt і=1 о, 


(viii) 


We may now put 


М... VP-Mon _ St р Mum S (ey My tos (ix) 
Om о, © Ур в imi \Р/ Omi 
Thus и, is a linear function of the standard e-score means in accordance with (viii) and satisfies 
the orthogonal condition that each u-score is a score of unit variance since the sum of the square 
of the linear constants (p; + р)? is unity. In virtue of (vi), we may also put 
(oaos hoo) VP Ves S A Mate 
о, i=1 ! Vp. Vas с, 
V (pA. Mi ies 
sd. = ee Ы x 
Е i=1 Mp V... Om.i 9 
Thus и» is a linear function of the standard e-score means and satisfies the orthogonal condition 


us 


Us 


Sp AP 
тнр. 


The definition of u, and иу is also consistent with the essential orthogonal condition that the 
sum of the cross products of the linear coefficients vanishes, since this sum is 


ise y. H.A 1 LII 
E EL 
2 C v». V... Wee 
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We may thus write (vi) in the form 


un ize ime 
(па. шс Y gw Sa. х . (xi) 
e i= is 


Hence the statistic so defined is a Chi-Square variate of (c — 2) degrees of freedom. The 
denominator of F,, in (i) is at once expressible in terms of the e-score distribution since 
(1 = mi a) Vo. es = M(Vo. acs) = Ea» Ev. (х».„ — Мь. аса)? 
= E, By. (хь. — My. a3)? — EM. acs — My. as)? 
= E, Ey. (6 a) — EM; ш), 


im jen i=e 


2 <M 
E mne ete e mte 

e с % е amen 
In the last expression we may pua as in 16:04 


Fy ten Yu 
Wie 
=1 


э 
2 2, 9. 


We may then define the value of w; in the range i = 1 toi = c as 
AS вла Ур. Motes Моле 


w, = = š B 5 . (xii 
© £1 уро, о, „ЕР (xii) 
(1 — ‘hee? Voice ‘SF ._ IS = 
— T w? — w = w. 
Л = : à = 


"Thus the statistic on the left is a Chi-Square variate of (p — c) degrees of freedom and we may 
write 


i-r 


2 2 ш 
Йа. — Tabes _ 6-3 (xiii) 
1 рете. | i= s" 5 b к 
Tha св ul 
iseti 


In deriving this expression we have defined by (xii) the w-scores excluded in the denominator 
in the same way as the u-scores of (viii). Thus the numerator and denominator of the ratio 
are statistically independent. We have been able to express the numerator in terms of the e-score 
distribution only because we assume linearity of regression. The expectation of the numerator 
of (xiii) will exceed this value on the contrary assumption. 'Thus the variance ratio whose 
distribution provides a criterion of departure from linearity is 


Ао) 5 
M ecc A eee ml dm f d. 
(1 — ты) cy 


"The ratio of the square of the deviation of the regression coefficient from its expected value 
to the unbiased estimate of the variance of its distribution we have seen to be 


(koa. cs — koa)? _ (koa. се — oa)*P - Va. s 
Shes s ; 


РЕ, 
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For what follows we may write this in the form 
(р — 2)(hoa. os — koa)? p - Vas 

ПФ. а 

АП the essential relations for a significance test of the departure of the regression coefficient 
from its expected value are implicit in the foregoing derivation of F,,. We first adapt (iii) 
above as follows : 

(1 — ravos) V o. os = EaEn . (хь. a — My. as)? — (My. os — My. a)? — (Roa. es — koa) Vo. s 
= E,E,. (65,4) — М — (koa. os — Fac) Va. n 


i-e jp, 


Е, 


2 6i 
А (1— 1.25 -Рь. ег 2, 2, ^" Mi (Е-е ki Pe Vans 
i % о о» 7 к 


'The first term on е right is а Chi-Square variate of р degrees of freedom, and each of the 
remaining terms is a Chi-Square variate of 1 d.f. Moreover, we have shown above that we can 
express the two latter as square w-scores included in the p-fold sum of square w-scores 
equivalent to the first term, Thus the expression on the left of the equation is a Chi-Square 
variate of (p — 2) degrees of freedom ; and the standardised sum of squares in the numerator 
of Е, in (xv) is equivalent to a w-score we have eliminated from the denominator. In short, 
Е, in (xv) is the ratio of a Chi-Square variate of 1 d.f. to a Chi-Square variate of (р — 2) d.f. 
defined more compactly as 
E (Reis a 

U= h r.os = 

This ratio defines the distribution of the deviation of the regression coefficient from its 
expected value whether the latter does or does not numerically exceed zero. If А, = 0 it is 
identical with F,, in (i); but we cannot otherwise express the distribution of the product 
moment index as a Type VI variate. In fact, of course, an exact test for zero covariance is 
redundant, since it suffices 

(а) to test first whether 7j,, significantly exceeds zero by recourse to the ratio denoted by 

Fy above, as in 16.08 ; 

(b) to test subsequently whether regression is linear by recourse to F,, in (xiv). 
The reader will note that the square root of F, as defined above is a t-variate of (р — 2) degrees 
of freedom, since the numerator has only 1 d.f. Thus we may use the ¢-table. Similarly, F,, 
in (i) is a t-variate ; and we may test for zero covariance, the appropriate f-ratio being 
5—2 
1—7* 

The derivation of a so-called exact test corresponding to (xxii) of 17.03 introduces no new 
issue of principle. If we have two independent samples of p, and р» paired scores respectively, 
we shall have two estimates of residual variance (02), viz. : 

R, pl — LTD LEER R, pA — т.а) >.з. 
h—2 à-—2 

Hence we may test whether the residual variation is the same in both samples by the variance 
(F) ratio 


F, 


t=r NEC. . (i) 


„® 


== (xviii) 
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1f this ratio does not exceed its expected value unduly, i.e. if it satisfies what criterion of signi- 
ficance we agree to adopt, we may proceed as in 13.05 and 16.07 basing our estimate of the 
residual variance on the mean. Thus we may write 
2 = 2 —2 s 

BL — 0... P uti ЕД т.) а= Pets 

Pr Pa 


of hà h-?2 b Po 2) 
Е,. MUV, ( : а= 
ean ы ATA A 


"ette 


btbt 
Accordingly we may define a statistic by the relations 
s Vos ж GE A ob me 
Bi.) =a and = ( Pug, 
s. А1 TM Ta Vor +241 — n. s)Vo.s (xix) 
hth—4 


The variance (o;.,) of the distribution of the difference (kas.ı — av.) is the sum of the 
variances of the distributions of &,,., and Ray.» i.e. 


1 T 
2 2 2 
dac 9.208 Bey ara) 


Hence we may take as our unbiased estimate of o;., 


2 " 1 1 ) 

брао = Se-e\ L—p 

> T E 
We thus obtain a t-ratio of (p, + Pa — 4) degrees of freedom : 


5o soc T МЫЙ (xx) 
Ske 

We have still to dispose of an issue mentioned in the opening paragraph of this section, viz. 
what is the probability that a particular observation will exceed its estimated value given by 
the regression line? We can set approximate confidence limits to the regression score, if we 
assume that the distribution of the e-scores is normal. The deviation of an observed value of 
the B-score from the regression estimate is by definition (xy. a — Xp. ws) = (x». a — Mo. cs 
kse. es- Х,.). For the same fixed value of the A-score within the fixed-A set the expected 
value of this is 


E(xy.a — My. es — Roa. os Ха.) = My.as — My. — kra Ха. = 0. 
We may thus write the deviation of (ху. a — x,. aes) from its expected value as 
(х».„ — My. a) — (Mo. cs — Mv) — (hoa. cs — Foa)Xa.s = e.a — Me. os — (Roa. cs — Roa)Xa-e. 
We have shown above that the squares of each term in this expression expressed in standard 
form are independent Chi-Square variates, if the distribution of the e-scores is normal. Con- 
sequently, we may regard it as the sum of independent components on that assumption ; and 


since the variance of the distribution of a raw-score deviation from its mean is necessarily that 
of the score itself, we may regard the variance of (x,., — Х,. ш) for a fixed A-score as the 
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sum of З additive components. If the estimate kj,.. (and hence the value of x,.,,, and 
My. ¢s) is referable to p paired scores, components аге 


Component Variance 
6.а o 
Ma. es о: 
(Boa. ca — Fea) Xa. Ха. ов. = (X1... 0%) + (р. Vas). 
If we write the variance of (x,. a — Ху. acs) as 02, a we thus have 
2 
d.e e) : ie XS (xxi) 


For computation it is more convenient to write this as 


ý & 1 
"MS а 7 Заве 


Since this expression involves V,., it presupposes the Model I approach, i.e. sampling 
with the sub-universe of the fixed-A set. If the e-score is normal, as we also assume in this 
context, the deviation (хь.„ — Ху. acs) involves the differences of independent normal variates, 
being therefore itself a normal variate. Thus a deviation (x,.. — x,.,4) from its expected 
value if as great as 20,. „ will occur about 1 in 20 observations in the long run. Actually, we 
cannot assign an exact value to оу, and must use our unbiased estimate s? of (xvi) іп 17.03. 
For an approximate normal test (when f is large) the appropriate square c-ratio is therefore 


Pads d 


By hypothesis the expected value of the numerator in the above is zero, and F,, being the ratio 
of a square standard normal score to the unbiased estimate of its variance, is a 2 variate of (p — 2) 
degrees of freedom. 


=F, S- co л б) 


17.05 Tue METHOD or Least SQUARES 


When we speak of a sample statistic such as yo. cs defined by (i) of 17.02 as the best estimate 
of a parameter (e.g. Аъ, in the notation of 17.01) of a universe, we may mean that it satisfies 
either or both of two criteria : (a) lack of bias ; (b) efficiency. An unbiased estimate is a sample 
statistic whose long run mean value, i.e. mean value for an indefinitely large number of inde- 
pendent samples, is exactly equal to the corresponding universe parameter. We have seen 
(р. 725) why ksa. cs defined by (i) of 17.02 is in fact an unbiased estimate of kya; and we shall 
now ask whether it is the most efficient one. 

We have had occasion to refer elsewhere to the concept of efficiency, but have hitherto 
formulated no general procedure for defining a sample statistic with due regard thereto, In 
this context two results established in 17.03 simplify our task. We have seen that the distribution 
of the regression coefficient is normal if: (a) regression is linear ; (b) the distribution of errors 
is normal. When the sample distribution of an estimate is normal, it is possible to define in simple 
terms a criterion of its statistical efficiency. We speak of one estimate as more efficient than 
another if we can assert with equal confidence that the true value lies within a smaller range 
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of values. When the distribution of the estimate, in this context kya. es, is normal with variance 
оў, the corresponding standard score of unit variance is (kpa. cs — Roa) — с; and we can 
assert with 95 per cent. confidence that kpa lies within the range ksa. cs +20, as indicated in 
16.05 on р. 696. To make the confidence range of Ё as small as possible we therefore have to 
define ksa. cs in such a way that o; is smaller than the variance of any alternative normally 
distributed estimate of kya. 

The principle of minimal variance last stated is another name for what has long been in use 
among physicists as a curve fitting device under a different name. The so-called method of 
least squares often invoked to introduce and to justify the use of the sample statistic defined 
by (i) as an estimate of the constant of a physical law expressed in linear form does in fact 
justify the assertion (Appendix II) that it is an unbiased one, as we have seen to be true 
(17.01) for other reasons. We shall now see that the statistic so computed has maximal 
efficiency, i.e. that kya. cs so defined has minimal variance, if we assume a normal distribution 
of errors. 

Actually, we do not know the exact value of оў, but we can regard the ratio of (kya, e — kva) 
to its unbiased estimate s? as a t-variate. Whence our problem is to define ksa. cs so that s; 
isa minimum. In (xvii) of 17.03 we have exhibited s; as a linear function of s; within the fixed 
A-set. Whence it suffices to define kpa. es so that s?is a minimum. We define the term x, . acs 
in the expression for s? to be a point on a line of which the equation is 


Er. aes == My. cs + kra. os: Ха. 
If we use E = E, . E,.,, for brevity 
E(&p. a — 2r . acs)” = Ё(хь.« — Mp. a)! — Bre. a » Ё(хь.« — Mo. o1)X a-s + Maio (Ха). 
Whence from (xv) in 17.03: 
P 
Py Eo Visa — Phoa. ea C (ioca) + Haa Vanes 


In this expression Cov (Xa. es . хь. es) is the sample covariance of the A-scores and the B-scores. 
If we are now to define kya. e in such a way that 52іѕ a minimum, we must put 


dst 
Ака. o 
o's — 2 Coo (x, са X). 0) + 2koa. cs- Va. a = 0, 


m __ Cov (Xa. css Xv. es) 
Ro ear 


=; 


In defining ksa. es in such a way that it is an unbiased estimate of kpa, as shown in 17.01, 
we have thus defined it so that s?and s? is a minimum. Since we can express (kpa. es — Ara) 
in terms of s? as a t-variate, we have therefore so defined it as to make its confidence range as 
parsimonious as possible. 


17.00 REGRESSION IN THE DOMAIN OF CONCURRENCE 


In statistical enquiries it may happen that observational data involving two variates, e.g. family 

income and sickness rates of mothers, appear to cluster near a straight line when plotted on 

graph paper. It is then possible to assign by the foregoing procedure a straight line of best 

fit for the regression of one variate on the other, e.g. mother’s sickness rate on family income. 
хт” 
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It is customary to speak of the equation definitive of the fitted line as a regression equation, 
and to regard it as a device for predicting the value of one variate when we know the other. 
Needless to say, prediction in this context means at best assigning confidence limits to a so-called 
expected value of the variate; but the legitimacy of doing so raises issues quite outside the 
scope of considerations which justify the argument of 17.02-17.03 in the domain of physical laws. 

As we have now seen, the procedure we call the derivation of a regression line is what 
physicists call the least square method of determining the best value of a physical constant ; 
and its rationale in this context of physical laws implicitly signifies what we have elsewhere 
designated a consequential relationship. With Pearson’s collaboration, Galton, to whom the 
term regression is due, applied it to such situations as the concomitant variation of physical 
measurements of relatives, e.g. when one plots the height of one member of a twin pair against 
the height of the other; but in such situations the relationship involved is concurrent (vide 
8.01 in Vol. I) and it is by no means clear that mathematical assumptions appropriate to a 
theoretical analysis of the sampling process in the consequential domain of a physical law are as 
relevant to concurrent relationships as Pearson believed. 

A paradox which confronts the student in a different context may serve to focus attention 
on the need to scrutinise such assumptions when we transfer them to the domain of concurrence. 
When the relationship under discussion is consequential, the square of the correlation coefficient 
is a precise measure of explained variance defined by the relation of = 7, . оў of (xvi) in 17.01; 
but this is not a rule universally applicable to situations in which linear regression arises. This 
we shall see more fully in the next chapter. Here we may dispel a difficulty which otherwise 
confronts the student, if we anticipate a conclusion established later, when we derive (p. 791) 
the correlation coefficient of two tests A and В as fa» = a,b, in terms of their so-called com- 
munalities a; and bł. Hence for two tests with the same communality 7a, = а which is the 
fraction of the variance of the test score distribution attributable to a component common to 
each set. Thus we identify the explained fraction of variance with the correlation coefficient 
itself in contradistinction to its square. 

We can get some light on this seeming inconsistency, if we recall the simplest form of the 
umpire bonus model of Chapter 9 in Vol. I, the score system being 


Xa = Xy F Хао; Xo = Xu F Xo 


In the consequential domain of the relation between the player’s score and that of the umpire 
we then have 


Oa b 


Tf both players toss the same die the same number of times с, = оу, so that fau = 7), and 
Tu = Tab = Tau 

To the present writer, it seems that this distinction resolves the paradox under discussion 
when we consider the way in which we derive a line of best fit by the method of the last two 
sections. In plotting the results of a physical experiment we may distinguish between two 
procedures : (a) each value of the so-called dependent variate, e.g. the stretch of a spring, plotted 
against a particular value of the other variate may truly correspond to one value of the latter, 
as when we successively measure the stretch produced by adding one and the same load to the 
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scale pan ; (b) each value of the dependent variate (e.g. blood sugar) plotted against one and 
the same value of the other variate (e.g. insulin dosage) involves an unacknowledged error of 
observation in the measurement of the latter. Either way, the customary procedure in the 
conduct of an experiment entails what we have tacitly assumed in fitting a line to our observations 
by the method of least squares, viz. that all the errors of observation arise in assigning a value 
to the so-called dependent variate. 

In terms of our model situation, we may therefore say that we treat the situation as a player- 
umpire relation whether our laboratory procedure does (5) or does not (a) involve concurrent 
liability of both variates to error. If, in reality, both variates of an experimental set-up are 
subject to error of observation, our method of plotting our observations transfers errors of one 
sort to the opposite side of the balance sheet, as if we were to assign to player B (the dependent 
variate) the score x, = Xu + Xa. o + X». о and the score x, = x, to player A in the umpire- 
bonus set-up. 

In theory ka» is the reciprocal of kya when there is no error variance, i.e. when тар = 1, 
since in that event 

ба ов 


Reg mf А 7, = Е & я „ i 
Та та (i) 


In laboratory practice, of course, this is not so; but the fact that application of the method of 
17.02 leads to two different lines of best fit does not constitute a dilemma. In the laboratory 
there is commonly a clear-cut operational distinction between the variate we deem to be 
dependent (e.g. volume) and the alternative one, i.e. the one which is more amenable to direct 
control (e.g. pressure). In applying the method of 17.02 to laboratory data we do not then have 
to make a choice between two ways of fitting a line. Admittedly, this is not always so. The 
laboratory worker may be free to choose one of two procedures: (а) to measure the stimulus 
requisite to produce a fixed response ; (5) to measure the response evoked by a fixed stimulus. 
In either case, however, fixing the value of the so-called independent variable may in fact be 
subject to experimental error, neglected by the way we plot our data. In terms of the allocation 
of errors to one or other side of the balance sheet, the two procedures are not identical. 

In laboratory enquiry, the very fact that one variable is under the control of the investigator 
signifies that the relation sought is consequential. On the other hand, statistical enquiries in 
the domain of sociology, psychology and biology commonly confront us with concurrent relation- 
ships of which the common element is not under control. The end in view may decide the 
proper choice of one or other variate as dependent, i.e. the variate x, when we speak of the 
regression of x, on x,; but what legitimate aims we may indeed pursue raises issues foreign 
to the considerations which commend the methods of 17.03-17.04 in the domain of experiment. 
If we plot weights of schoolboys against age (or vice versa), we may adopt one of two procedures. 
In these days of computing machines, it is common practice to determine a value of Cov (Xa, хь) 
based on the cross-products of all the scores, and it is no longer clear that we have to conceive 
the sampling process as restricted to the sub-universe of the fixed-A set or of the fixed-B set. 
Alternatively, we may group all children of over 8 years and no more than 8}, labelling the age 
of the group as 8] years. Our calculated т will then be based on cross-products of the B-scores 
(weights) and the corresponding fixed age group medians. This procedure is superficially more 
like laboratory procedure than is the alternative ; but the likeness holds good only in the 
domain of arithmetic. 

"The implications of the use of curve-fitting by least squares do not admit of any formidable 
ambiguities in laboratory practice ; and if we fully understand the implicit, as well as the explicit, 
assumptions we make when we use the methods of 17.03-17.04 for the analysis of experimental 
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data, we shall avoid the pitfalls which beset us when we use the technique of regression in 
statistical enquiries outside the laboratory. Contrariwise, a too facile view of the similarities 
between the two situations will assuredly lead us astray, At the start, we should be clear about 
the implications of the fact that the method of least squares transplanted into the field of biology 
and sociology by Pearson was originally a theory of error, a basic assumption being that the 
physicist can control every relevant variable in an experimental set-up other than variation 
arising from unreliability of his recording apparatus, such variation being free from systematic 
bias. In biological experiment, one has commonly to take stock of individual variation, e.g. 
with respect to genetic constitution ; but the investigator, with a justifiable intention of pro- 
pounding a law, implicitly assumes the possibility of repeating observations based on different 
individuals without introducing a systematic source of variability. 

In fact, we assume more than this when we invoke statistical tests dealt with in this context. 
Our postulate is that the source of residual variation is the same for all samples ; and this makes 
the Principle of the Fixed-A set the king-pin of our theoretical edifice. The postulate itself is 
admissible in comparison of physical experiments in which investigators of equal competence 
employ the same instruments or instruments of equal precision ; but we shall shun the tempta- 
tion to regard statistics as an efficacious remedy for shoddy experiments in the biological domain, 
if we are alert to the need for factual support to sustain the proposition that the non-systematic 
components of variation in different samples of living creatures are necessarily equivalent. Only 
the strictest attention to selection of stocks standardised with respect both to nature and to nurture, 
age and season, can confer plausibility of any such assumption implicit in what Churchill 
Eisenhart calls the Model I approach. The admissible postulates of physical experiment, and 
those the biologist may be able to adopt with justifiable confidence on that understanding, are 
at least open to grave doubt in many situations which prompt sociologists and psychologists to 
employ regression equations. In such enquiries, what is usually a more important source of 
variation is a complex of external agencies we have no power to control. Were it otherwise, our 
residual variance would be simply a measure of the failure of our powers of observation to detect 
a law of nature. As it is, our residual variance is to no small extent a record of the inadequacy 
of any simple law as a valid description of our observations, and an admission of our power- 
lessness to recreate a unique historic event. 

To make the last assertion more tangible let us recall the law of the stretched spring. When 
we state such a law, the end in view is to tell us by how much we can extend a spring, if we 
measure the extension with sufficient accuracy under specified loads. A latent assumption is 
that our laboratory is static. The results would indeed be different if we made our observations 
in an aeroplane at different (and unknown) heights above sea level in virtue of variations w.r.t. 
the gravitational constant g. The best we could then hope for is that we could distribute our 
observations on the stretch with respect to a specified tension so that differences with respect 
to elevation would be uniformly distributed. Even in the absence of error inherent in the tech- 
nique of observation as such, our line of best fit could then tally with the one definitive of the 
physical law of the static laboratory only in so far as it described the trend of averages. Figura- 
tively speaking, the laboratory of the social scientist and of the vital statistician is always an 
aeroplane of unknown and changing height above sea level. Errors of observation in the 
Gaussian sense may be, and indeed commonly are, trivial components of the residual variation 
undetermined by the course of the regression line. 

If it is important on this account to recognise that we cannot rightly equate the residual 
variation of the sociologist or of the vital statistician to instrumental or personal errors of observation 
as in experimental science, it is no less important to recognise that any statement of a scientific 
law is complete only in so far as it implies a specification of its own limitations. The laboratory 
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worker familiar with such limitations can commonly shirk the obligation to make them explicit 
without compromising the usefulness of conclusions drawn from the law itself. Thus we can 
safely use an equation prescribing how the density of water varies in relation to temperature 
at 760 mm. atmospheric pressure without incurring the temptation to invoke its aid to prescribe 
the density of steam at 120° С. and sea-level pressure. We learn at school that Hooke's law 
breaks down if the extension approaches breaking point, and that Van der Waals' equation has 
to replace Boyle's simpler and for most purposes good enough rule in the neighbourhood of 
absolute zero or of the critical pressure. The explicit algebraic formulation of a physical law is 
always incomplete from this viewpoint, but the experimentalist translates it in action with the 
reservation that the correct interpretation carries with it a supplementary specification of the 
boundary conditions of its validity. To say this is to say that the legitimate use of an equation 
definitive of a structural law in physics lies within the domain of interpolation ; and the teaching 
of elementary physics familiarises us with the absurdities which arise when we use it for 
extrapolation beyond the boundaries of its applicability. 

This is indeed precisely comparable to what we do, if we succumb to the temptation of 
using a regression equation as a basis for predicting how a wage increase will affect fertility 
or infantile mortality. What is a sufficiently well recognised truism in experimental science 
is a caveat we too easily ignore in sociology and vital statistics. For instance, we cannot legi- 
timately infer from the regression of completed family size on family income what the completed 
family size would be, if we stabilised all incomes at a fixed level, thereby changing the framework 
of conditions in which the regression relation is valid. "The statistical literature of the last fifty 
years abounds with conclusions of this type, though it is easy to detect the fallacy, if we take 
stock of a fundamental difference between experimental investigation and statistical description. 

We have alrezdy had occasion to recognise that there is a clear-cut distinction in experimental 
science between what we commonly call the dependent and independent, or as we might more 
informatively say consequent and antecedent variates. The antecedent (so-called independent) 
is the one which the investigator has under his direct and deliberate control; and commonly, 
though not always, it is the only one within his power to control with ease. For instance, we 
cannot fill a hypodermic syringe with adrenalin by raising the blood pressure of the patient ; 
but one can raise the blood pressure of the patient by injection of the contents of a syringe 
containing adrenalin. 

Now we recognise a relationship as consequential because, and only because, we are able to 
interfere actively with the course of events ; but we are not recording the result of any such active 
interference when we plot a regression graph of completed family size or maternal morbidity 
on family income. At least as likely as not, the relationship involved is concurrent ; and our 
plotted data cannot give us any assurance to the contrary. The algebraic treatment of correlation 
in Chapter 12, in contradistinction to the more customary geometrical approach, can indeed 
make this logical distinction explicit. We can influence the score of player A, if we record wrongly 
the result of the umpire's score ; but we cannot do so by recording the score of player B wrongly. 

In this context, however, a factual as opposed to a schematic illustration may prove more 
helpful. We may imagine a situation not uncommon in Asia or Africa, viz. a population subject 
to malaria spread over a dry hillside and swampy lowlands around it, the more prosperous 
Herrenvolk householders having settled on the heights. In the nature of the case, we should 
then expect to find a correlation between mean income and malaria incidence in the various 
precincts, and it might well happen that we could plot our statistics as a linear regression graph. 
In this set-up raising the income of the less prosperous sections of the community might permit 
more migration from the swampy lowlands and hence less risk of malaria, but only if there 
were still land available for building on the uplands and only if there were no commensurate 
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increase in the value of house property. In the absence of any information about the availability 
of alternative accommodation and the prospects of the building market we therefore lack sufficient 
reason for inferring what effect an all-round increase of income would have. Since our regression 
equation contains no information of this sort, it cannot legitimately lead us to forecast the effects 
of income change. 

We may now sum up as follows what we can legitimately mean by prediction in descriptive 
statistical enquiries : 


(a) a regression graph specifies a sub-sample representative value which we can circum- 
scribe by confidence limits by the methods of 17.03-17.04 on the assumption of a normal 
error distribution ; 

(b) of itself, the regression equation implies no information concerning the causal relation 
between the variates, and does not entitle us to make assertions concerning the results 
of human interference ; 

(c) even if we have additional sources of information to identify the relationship of the 
variates as one of antecedent to consequent, it is still necessary to remember that : 


(i) a regression equation describes occurrences in a specified framework of repetition ; 


(ii) assertions concerning the effects of human interference will not necessarily be true 
if the latter prescribes a different framework. 


In what we have discussed so far, all the emphasis has been on the distinction between 
the consequential domain of experiment and a concurrent domain which is amenable only 
to passive observation. The distinction has an implication which is worthy of more explicit 
comment from a viewpoint adumbrated in a passing remark to the effect that every sociological 
situation is a unique historical event. In the derivation of the significance tests of this chapter, 
we have assumed what we here call the principle of the fixed-A set. In other words, we view 
the situation from the viewpoint of what Churchill Eisenhart calls Model I, i.e. as one we 
can repeat at will in the same way. In a well-controlled laboratory set-up this is a meaningful 
assumption. It is at least permissible to doubt whether it has any meaning whatsoever in the 
domain of sociology. Admittedly, it will have one for those who can stomach Plato’s conception 
that the shadow world of human experience is but a sample from the infinite and eternally 
repetitious universe of universals. To others, its semantic credentials will be less patent. 


17.07 PaRTIAL REGRESSION AND MULTIPLE CORRELATION 


Hitherto we have confined our attention to regression as a linear relation between two variates. 
Perfect linear regression of the B-score (x;) on the A-score in a bivariate universe signifies that 
the mean B-score (М,. „) associated with a particular A-score (х„) is directly proportional to 
the latter, i.e. 

Mya = fux C ог Мь.„— My = kya. Ха. 
If this is so, certain identities follow as tautologies of the grid which summarises the structure 
of the universe, in particular 

Cov (x, х) = kra. V, and V(M,.,) = kta Va 
In random sampling from the bivariate universe of the consequential domain, the unbiased and 
most efficient estimate (kya. „) of Аъ, has the same relation to the sample covariance and sample 
A-score variance, viz. : 
Cov (Xa. css Xo. os) 

Va. cs б 


Roa. es = 
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"These expressions constitute a particular case of a linear relation involving several variables. 
For our purpose it will suffice to illustrate the pattern by consideration of the case which arises 
when we prescribe the mean value (M, . a») of one score (x) in terms of particular values of two 
others (x, and x;) connected therewith by the linear relation 
My. av = ea. 5. + Rau xy + К 5 б š у!) 
The mean value of M,.,, is the mean C-score value for the particular set of A-scores and 
B-scores which with them constitute the trivariate universe, whence we can eliminate the 
constant K in the usual way : 
M,— Ra. М. + Реь.а. My К, 
— My. av — Me = Rea. (%a — Ma) + ev. (хь — My), 
OM — Me = kea.» - Xa + К.а Xo . а : : . (ii) 
Tautologies of Multiple Regression. Equations (i) and (ii) define the relation between the 
mean C-score and particular values of the A-scores and B-scores of a trivariate universe in which 
regression of the C-score on the other two scores is exactly linear. Wecan visualise such a universe 
in the idiom of Chance and Choice as the long-run result of a game of which the 3 recorded 
scores аге: (i) the player С; (ii) an umpire A; (iii) an umpire B, as in the model of 12.01. 
To make the model as general as possible for our purpose we need not assume that the scores 
(x, and х,) of the umpires are independent. Thus we are free to regard them as correlated іп 
virtue of the contribution of a third umpire to each of them. The rule is that the player adds 
to his individual (and hence independent) score (x,) some multiple (Rea. == ka) and (kes. a = ko) 
of each of the umpires, so that 
Se= Het hy Kathy. % « " 2 3 ANON 
In terms of deviations from the score component mean values (M,, M,, M, and Mj) this is 
equivalent to 
X, =X, +hy-Xat hy. Xo. 5 - 3 . (v) 
Since the individual score (х,) of player C is independent of the umpire's contribution, 
it can take any value for a fixed value of the A-score or the B-score, so that M,. a» = M, being 
therefore constant and equivalent to C in (i). "Thus regression of the C-score on the A-scores 
of the two umpires is linear. 
If we multiply (iv) by Xa or X, and take the mean value of the product, we at once derive 
as a grid tautology 
Соо (Xa, х,) = Cov (x, Xa) + Ra. Va + y Cov (Xas х) 5 
Cov (xy, х,) = Cov (Xe, хь) + №. Vy + ka Cov (xs, хь). 
Since the player's individual score is independent of that of either umpire, the long-run value 
of Cov (Xa, X.) and Cov (xp, x,) is zero and 
Соо (Xas х) = Е,. Va + ky Cov (xa, x) + T c " (0 
Cov (xy, x) = ky . Vy + ka Cov (Xa, x) + Fy Е . (vi) 
We can now eliminate k, ог А, e.g. if we put 
Соо (Xas х,) Cov (Xas хь) = ka - Va . Cov (xa, хь) + ky Соо? (хь, хь); 
Cov (хь, x;)V, = Ra. Va. Cov (ха, хь) + hy. Va. Vo, 
Cov (Xas Xe) Cov (Xas xy) — Va Cov (хь, x.) 
Cov (xs, ж) — Va- Vs 


„®% 
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Similarly, 
Cov (хь, х.) Cov (Xa, x») — V, Cov (xq, x.) 
Cov? (£a, ху) — V,. V, 
For convenience at a later stage, we may write these results in terms of sums of square 
deviations or products. If the 3-dimensional grid contains л score triplets, we may write 


ka (viii) 


j=n pon 
Sj—n.V,— > XP and Sy= У Kis Ху. - с meon 
j=l pal 
The above expression then takes the form 
Sve» Sav — Soo + Sac _ Sac + Sav — Soa Sve 
ka 5З, — ы. Swe and k, ‘Sh SES е 3 (x) 


The partial regression coefficients k, and k, are expressible in terms of partial correlation 
coefficients. For brevity, we may first write 


RaSh ad Жу, == ha NE) 

[^ CA 
If we substitute for Cov (x,, x») in (vii)-(viii) ray . o, . o and mutatis mutandis for Cov (Xa, x), 
Cov (хь, хә), we derive 


Tac — Tre + Tar Tro — Tao - Tab + 
Kea. = a and K4.,-— aa : : . (wii) 
ab 


So far we have considered the regression of the C-score on the A-score and the B-score, 
in which case there is no ambiguity in the substitution А, = kea.» If our concern is with the 
regression of the A-score, we need to distinguish k.a . » from kae.» in the corresponding regression 
equation from which we derive the former in the same way, and write more fully 

Kees = heat and Kea. = hea. 
с, Te 


Whence we obtain 
(Tae — Toe. Tas)? m 
Жол Жеш у= EU BOT T 8 А А . (xiii 
wa Ken = (ү. уп (шу 
Whence from (iv) of 12.08, we get 
Ka Kea. = fam Ё. 0. Ко = . . . (xiv) 


Similarly, we may define the remaining 4 regression coefficients in terms of 7a». e and ry, a. 
The use and build-up of what it is customary to call the multiple correlation coefficient is 
easy to understand if we visualise the 2-dimensional grid of simple linear regression as a scatter 
diagram, i.e. a cloud of points on a graph. A product-moment index approaching unity then 
signifies that the points cluster closely round the line of best fit defined algebraically by the 
regression equation. We may express this conception formally in another way, as in the 
derivation of (xxi) in 11.04, To say that such a line gives a perfect fit to the data means that all 
the points lie on it; and this signifies a one-to-one correspondence of x, to M,., for every 
value of x,. If regression of x, on x, is indeed linear, interchanging the then equally spaced 
values of M,., at the foot of each column of the score-frequency grid with the equally spaced 
values of the x, border-scores at the head of each column, is equivalent to a change of the origin 
and scale of the A-score distribution ; and we have seen (p. 353, Vol. I) that this does not affect 
the value of r,» In other words, the p-m correlation (fam) of x, with M,., is the correlation 


REGRESSION AND DISCRIMINATION 755 
(Tas) of x, with x, when regression is truly linear, and its numerical value is a yardstick of the 
good fit. Formally, we may express the identity thus 

EX... — My] 
T" NRW...) 
In this expression linear regression implies (xi) in 11.04, i.e. that V(M,.;) = Kj, . Va and 
EX (M,., — My] = ho. a E(X, . Ху) = №... V Pai Vo -Tan 
Mya = far 


These considerations suggest that we may profitably explore the correlation between the 
actual value of X, and (Ms. as — M.) in (ii) above as a criterion of satisfactory fit, i.e. how 
closely particular values of X, correspond to corresponding mean values on the assumption 
that 2 other variates are relevant. Accordingly, we define a multiple correlation coefficient 
for such a set-up as 

_ Cow (xe Me. ar) 


= УРИМ, a (xv) 
In (xv) the value of V(M,. a») follows from (ii), since 
(Me. av — M)! = Е. Xi + hy Хў + 2ka hy Xa. Xr, 
ws И(М,. av) = kè. Va + 6.0, + 2м. ky Cov (xas x) . . (xvi) 


Similarly, 
X, . M, = М(Х,. Xa) + RC. Xr) + Me. Xo 
2. Cov (x, Me. av) = ka Соо (Xa, х,) + ky Cov (хь, х.) А З . (xvii) 
Whence from (v) and (vi) 
Cov (хь Me. an) = Kè - Va + BE. Vy + 2kaky Coo (xs, х). 
Hence from (xvi) 
Cov (x, M, . a») = V(M.. a). 


Whence from (xv) : 
_ Coo (£o М...) 


2 
Ri V. 
ka Cov (a) Xe) " ky Cov (xy, x.) 
V, V, 
= т. ifi m 
о, с, 
nuc d ERES... seo nih 
L^ LO 


The analogy between the multiple correlation coefficient (R.) and the product moment index ray 
of the bivariate universe extends beyond the explanation given above. We may identify the 
true value of the C-score with the universe mean (M, . a»), in which case, (iv) takes the form 
Х,= M,.a d X, 
s Ve = V(M,. a) + Ve = Cov (xo Me. a) + Ver 
eV. Vet Vin 
2 V, = (1 — ВЭР, 
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The Unbiased Estimates of the Coefficients. So far we have defined k, and k, as constants 
connecting particular values of X, and X , with the true value of (M, . ap — M;). As with simple 
linear regression, we can define unbiased estimates of k, and k, if we look at the problem 
as a case of Churchill Eisenhart’s Model I (p. 548). We conceive that we are repeating 
observations of the C-scores on exactly the same set of A-scores and B-scores in each experiment 
of which we have a sample before us. In our model set-up the player's individual score com- 
ponent (X,) now takes the place of the error or residual source of random variation. We shall 
denote the operation of taking a single n-fold sample of score triplets by E,( . . . ) and the expected 
value of a sample parameter by E,(...). Thus 


Cov (xa. „ Xo. s) = En(Xe.Xa) + ka. Vois + Ry Cov (xa. „ ху. a)y 
г. E,. Cov (xa. s Xo. s) = E, EX, Х„) + R EV.) + hy. E, Cov (ха. Xv. a). 


Now the expected value of E,(X,.X,) is zero in virtue of the independence of the error com- 
ponent of the C-score; and V,., is constant within the framework of the Model I set-up, 
as is also Cov (Xa, x»), so that 

Ey, Cov (xa. s Xe. s) = ka. Va. a + В. Cov (xa. „ Xo. s). 
Similarly, 

E, Cov (xy. „ %¢.s) = ko. Vy. a + ka Cov (Xa. „ 3. }). 


By elimination in the usual way we have 


Сою (Xa. n хь.) Е,. Cov (ху. „ Xo. 1) — Vo. Ё,. Cov (Sa. „ә. a) 
Coo* (£a. „ y. a) — Va. ae Voe 


ka 


_ Е, Cov (xa. „ хь. s) Cov (xy. s Xo- s) — Vo.« Cov (Xa. m Xe. a) 
Cov? (xa. ss Xy. s) — Va. s- Vo. s i 


We may thus define the statistic which is an unbiased estimate of k, within the fixed set of 
A-scores and B-scores by the relations 
E (ka. s) = ka 
and 


Cov (Xa. „ хь. a) - COV (Xy. „ Xo. a) — Va s COU (Xa. s Xo. a) 
Cov? (xa: „ Xv. s) — Va. a. Р.а 


bs (xix) 

In conformity with our derivation of the most efficient estimate of Àj, in samples from a 
bivariate universe, we shall suppose that the C-score is divisible into two components, one (x,) 
directly proportional to both x, and x, and the other a residual (x,) whose mean square deviation 
(Va. ,) from its sample mean value (M,. ,) is to be a minimum by appropriate choice of the 
linear constants ka., апа ks., defining the relation of x, to the A-score and B-score. By 
definition therefore 


Xe = Xr + Xe = ka. s- Kat Rao HK +x, . . (xx) 
We can eliminate the constant K in the usual way, since 
M,—C-—h.,. M, — hy. a- М. 
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Whence we can express (xx) in terms of the deviations of the score components from their 
mean values as 


Xe = Ra Xa t hy. ХХ, меои Т; (xxi) 
2 XP = Х + RAG + kb Xp — ha. „Х.Х, — Why. „ХХ, + Wha. sko. „ХХ, 
S Veca m Ve. a + Maas s + Mao. — Wha. s Соо (xa. „ Xe. a) 
— Qky. , Cov (xy. s Xe. a) + 2ka. sko. a Соо (Xa. „ хь. а), 
CU 
57 чаи = 2%. Va. s — 2 Соо (xs. х.) + 2ko. s Cov (Xa. „ Xo. a) 
and 
Wes 
Fy Mime se Gon ice х...) + 2ka. , Cov (Xa. n Xv. 1). 
The condition which makes V,., a minimum is that 
MA. n. Vus 
NU TT S 
^s Ra. gs Vaca = COO (3a. „ Xe. 0) — Ky. ‚ CoU (A5. „з. a) T (xxii) 
and 
К. Va. о m CoU (ж. „ 35. a) — Ra. „Соо (2o. 5.39.0) : (xxiii) 


Our definition of the sample parameters which define the slope of the line of best fit in the 
sense that the residual variance is minimal thus correspond to the unbiased estimate of the 
universe parameters k, and kp. 

The student should be able to extend the foregoing derivations to regression involving 
more than 3 variables. When we have more than 2 regression coefficients to evaluate, it is 
preferable to solve the basic equations of the form exhibited in (v) and (vi) or (xxii) and (xxiii) 
by recourse to determinants. In the notation of sums of squares and products, the basic equations 
for a set-up involving four variables (regression of x, on Xa, x, and x,) take the form * 


Saa = Ra» Saa + К. Sav + he Sacr 
Sy = Ry» 5 + Ba» Sav + he» 5 
Sea = ke « See + a+ Sac Ry. Sree 


Numerical Example. The following are 3 associated variables. 


Xa х Xe 


5 2 21 
3 4 21 
2 2 15 
4 2 17 
3 3 20 
1 2 13 
8 4 32 


"Totals 26 19 139 


Means 3-714 2-714 19-86 


* For computation short-cuts see Mordecai Ezekiel: Methods of Correlation Analysis. Wiley, 1941. 


758 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


For purposes of computation we may more conveniently work with raw-scores than with 
score deviations. We then write 5; as the sum of the score x; so that M, = n. s; and Si, Sis 
as the sum of the squares of x, and the products x. x; respectively. For an z-fold sample we 
then have 


SiS 


S; = Su = апі Si = s; (xxiv) 
We shall therefore need for the case of 3 variates (хь, хь, Xe) the following column total raw-scores 
(Say So» Se), square ditto (Saas Sop» Sec) and products (s, . s), Sa . Ses Sp» Se)» 

Our first step is to tabulate sa, S» etc., as below : 


=, хь =, x P zt хл, ae XX. 

5 2 21 25 4 441 10 105 42 

3 4 21 9 16 441 12 63 84 

2 2 15 4 4 225 4 30 30 

4 2 17 16 4 289 8 68 34 

3 3 20 9 9 400 9 60 60 

1 2 13 1 4 169 2 13 26 

8 4 32 64 16 1024 32 256 128 

Total 26 19 139 128 57 2989 77 595 404 
fs зь Se = f See p See See 


From the above we obtain by recourse to (xxiv) 


в (28210) МБ. но. E 
Sa, = 77 7 =73 Sea = 128 — 0 = 
(139.26) 551. ETE 887 
Sac = 595 : T’ 5» —57— ee 
(139.19) 187. E . (189)? 1602 
S, = 404 > 7 S, = 2989 — 7 = 


We thus derive 
220k, + 45k, = 551, 


45k, + 38k, = 187, 


12523 

== = 1977, 
16345 

ky = тосе = 2580. 


Our regression equation for the predicted value (x,) of x, is thus 


139 26 19 
(s 7 ) 1977( xa =) + 258( 7 ) 


If we write as the error x., a of x, for a fixed value of x, and хь, the equation of the C-score 
distribution in terms of the estimated value of k, and k, is 


X. = ka. Xa + hy. Xo + Xe. am 
s XP = ka. Xa. Xo + hy Х,. Xe + Xe. ay Xo 
w+ Ve = ka Соо (Xas Xe) + Ry Cov (хь, X.) + Cov (Xe. a» . £e). 
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Alternatively, we may write 
V, = Е.Р, ER. V, + Ve + 2 Cov (Xas хь) + 2 Соо (Xas х,. а) + 2 Соо (хь, х,. а). 
In any case, the fraction of variance explained by the dependence of the C-score on both 
the A-score and the B-score is 
ka Cov (Xas £e) + Ry Cov (хь, x.) F KV, + KV, T Cov (xa; x») 
V. Ц с Р 


In this case 
Ro -3098155.- 
It is instructive to compare this result with the corresponding measure of explanation 
calculated on the assumption that the A-score distribution is the only relevant source of systematic 
variation. Our prediction equation is then 


139 26 Cov (Xa, х.) _ 551 “4 
Xe 7 (к = ) HU V. E 290 2.505. 


On this assumption 
Kea» Va 


; = 0-8614. 


* * * * * 


Significance of Individual Variates. "The foregoing numerical example raises the question : 
how can we decide whether it is advantageous to take stock of an additional variable ? By the 
method of 17.03 we may obtain 3 independent estimates of error variances for л triplets on the 
assumption that variation w.r.t. x, and x does not contribute to that of xe. 

E(K,.8,) = о, 
E(K,. So) = о, 
s (Se Sesh 8) 
n—3 
Expected values of the statistics А, . S,,and ky . Sp, will exceed c? if there is significant regression. 
We thus derive two variance ratios as a basis for the commonly prescribed test of the significance 
of the contribution of one or other variate : 

(n — 3K,. Soc FR 

S.—h.Se—h-Sw ° 


=o 


(n — 3)Кь. Sve 
Sí — ha» Sae — Б. Sne 


F, (xxv) 


17.08 THE DISCRIMINANT FUNCTION 


If two classes A and B (e.g. males and females) differ w.r.t. several measurable attributes, any 
one such difference may be absolute in the sense that A’s measurement is always greater than 
that of B (or vice versa); but class differences are none the less genuine if expressible only in 
terms of averages. When this is so a single measurement has little diagnostic value. Thus 
the fact that the mean height of men is appreciably greater than that of women in the same 
community does not entitle us to assert with great confidence anything about the sex of an adult 
whose height is somewhat below the average for females. On the other hand, our assurance 
would be legitimately greater if we knew that several measurements (e.g. neck girth, hip width) 
made on the same individual lay nearer to the female than to the male population mean. 
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In combining such observations the value of adding a new one will depend partly on whether 
the sampling variance is small or great and partly on whether it is or is not highly correlated 
with another already included in the test battery. The fact that some measurements will pay 
better dividends for diagnostic purposes than others therefore raises the issue: what is the 
best way of weighting each of the observations of the test battery when we combine them in 
a single index? To get the issue into focus it will suffice to consider a test battery involving 
only 2 measurements (U and V) as in the accompanying schema : 


Individual Values Population Means 
A B Difference A B Difference 
U Xj. au Ху, bu dicu =j au — у.м мМ. Mu.» M... 
Us Xj. av Xj. dj. o = Xj. av — Xj. 08 М,.. M,., Mi.» 


If we gave each type of measurement equal weight, the mean values of our diagnostic indices 
would be { Mu. a + Mo. a) and }(M,.,-+M,.»). Otherwise, we may represent them as 
I,=C,.My.c+C,.M,.. and = Cu. Muy Co- M... . Ey 
For two individuals taken at random, one from each population, the corresponding sample values 
(Sa and S,) and their difference (D) will then be 
S, = С... + С„. ху. and S, = Cy. xj. bu H Co- Xy _. . (à) 
D = Sa — 8 = Cu- di. u + Coo dj. o 
The mean value of D is then M; = C,. Ma. u + C,. Ма... If we assume an approximately 
normal distribution of individual measurements, and hence of D itself, we may prefer to define it 
in such a way as to minimise its variance and hence the limits within which our estimate of D 
will lie at a prescribed confidence level. Our problem is then to specify C, and C, in conformity 
with this condition. We first note that the partial derivative of the square standard score, 
d (D—M,)? AD—M,) D (D—M WV 
2C" V y "C y C» 
The expression on the left vanishes when 
эр (D— M) W 
IE —9E- t3 


Thus to maximise the square standard score of the difference distribution we have to solve 
two equations : 


Dee 5 (D-M) »V . 
ЖОШО 2V "3029 
2D d (D— M) W 
No acit OF — DAD 
Whence we have 
Фр = den у (iii) 


Now the variance of the D-distribution will be the sum of the variances (V,., and V,.;) of 
the distributions of S, and S, in (ii). If V,,., is the variance of the distribution of Xj, aw etc. : 


= СЕ. Vesa Сз. У... + 2С„. Cy. Cov (x. ou, а.в») 
У. С. У.С V, + 20,. С, Coo (Sow X00) 
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For brevity we may write 
Vu.a + Vu. = ты; Voa t+ Voy = ть . ` . (v) 


Cov (ху. aus X5. av) + Соо (Xj ou, Xs. 00) = Muve " E . (vy 
We then have 
V — V,.a + V, = Co. Muu + С.т, + 2С,С,. т, 


are 2a = 2(Cu . Muu + Cy. Mue) and Je 


= (C, thee + Cu. ma). 


2C, 2C, 
Whence by substitution in (iii) 
di. (Cy mt. + Cy. Myr) = dj. (Cu mus + Cy. Mur) B я (vi) 


Since m,,, Myy and My, are parameters of the distributions of measurements, the expressions 
in parenthesis on each side of (vi) are constants and we may write 


Mi (C, ma + Cy. thas) = Mi {С,.т. + Cum) — 0.0. (бй 


If we weight our diagnostic index in the usual way, (C, + C,) = 1. The values of both 
constants are then obtainable from (vii) in terms of the population mean differences, variances 
and co-variances. Actually, it is immaterial how we fix one of them, since the multiplication of 
D by a fixed constant does not affect the ratio of D? to V. Thus we can write C, = 1 and 
solve accordingly. . 


Numerical example. For two measurements each made on 4 males and 4 females, the 
following will serve : 


U v 
Individual 
A B A B 
1 11 12 8 3 
2 12 14 12 4 
3 14 16 10 2 
4 15 18 10 7 
Mean 13 | 15 | 10 4 
Difference | -2 | 6 
For this set-up 
Mi.u=—2; M,.,—6; 
Соо (xy. a 3.5) = 15; Cov (xu. w Xv.) = 95; 
V,.,—25; V... —5; 
V, 20; Vs. —35; 
Жы = 75; Ma = 3 ma = 5-5, 


By substitution in (vii), if we put C, = 1 
255 C, +3) — 675 +3 C) 


51 
С, = —39 
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‘Thus our diagnostic index is 


51 
S = Xu — ag'e 
For the two populations its mean values are 
10(51 
Tg MODE IS 


29 


451) 
4-15 — S = +80. 


* * * * 


Generalisation of the Evaluation. In circumstances which call for the use of such a diagnostic 
index (discriminant function), we shall commonly have more than two measurements to combine, 
and we may write more generally for p of them 


Se S E о) 


MO Qu 
ыл, 3 
nc ete 
Thus we have a set of equations of the form 
D — M, 
Mia = ОМ (c, my + C, tag + бу. masse Cy ts) 
D — M, 
Mg. 0799 (o, m + C, m Cu mae Co a) 


etc. etc. 


As before, Mnn is the sum of the two variances of the nth measurement, Mpx being the sum 
of the two covariances of the nth and Ath. We are at liberty to solve by setting C, = 1, the 
constant (D — Му) + V being then irrelevant, and our equations thus take the form 


Mi. n= ты + Co. tng + Cy. та, ес. . , В a) (х) 


The foregoing treatment sets forth how we initially determine the values of the weights 
we employ to get the best diagnostic index embodying different sets of measurements. Having 
done so, we may use it as a classificatory device. "Thus we determine S in (viii) for a doubtful 
specimen and assign the latter to class A if the numerical value obtained lies nearer to Ją, its 
A-class mean value. 


Addendum. 'Two of my younger colleagues who kindly read through the proofs of this chapter 
have expressed the misgiving that I may have overstressed the limitations of the Gaussian Theory 
of Errors as an instrument of research in biology and the social sciences. It is refreshing to 
recall the preface and argument of a still standard exposition of so-called regression. Therein 
Brunt (1917) states (The Combination of Observations) : 


The proof of the Normal Error Law has been based on Hagen’s hypotheses regarding 
errors of observation. In most of the problems of Astronomy, Geodetics, and Physics the 
errors of observation satisfy the hypotheses, and the application of least square methods is 
justified, But cases may arise in which particular care is necessary in applying these methods. 
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This is especially true of Biological problems. For organic variability is the resultant of a 
large number of contributory causes, some of which may have a definite tendency to act 
always in one direction. The effect of such a bias is to produce an unsymmetrical frequency 
distribution, and the application of ordinary least square methods is then meaningless. 
It is thus in no way justifiable to regard Least Squares as a magical instrument 
applicable to all problems. 


I recommend Brunt's book to any biologist or sociologist who entertains a reasonable 
scepticism about the credentials of a theory of curve fitting based on the pioneer work of Gauss 
and Hagen in the thirties of the last century when so recently imported into a domain entirely 
foreign to their intentions. The first few chapters are well worth reading for another reason. 
On all sides, we now hear that science has relinquished the quest for absolute truth by embracing 
the doctrine that its laws are merely statistical. "This is at best a half truth, unless we exclude 
all forms of taxonomical enquiry from the title to rank as science. Even so, it is profoundly 
misleading. Statistical is an epithet with at least five different meanings in current educated 
speech. In the context of the assertion cited, it covers: (a) a calculus of aggregates (e.g. the 
kinetic theory of gases or the genetical theory of populations); (b) the Gaussian calculus of 
errors of observation ; (c) а calculus of judgments. In this chapter we have seen reason for the 
doubt Brunt expresses and the need to re-examine the assumption that (5) and (c) have anything 
in common other than the algebraic devices they invoke. In Chapter 20 we shall see how little 
agreement exists w.r.t. assumptions common to (a) and (с). 

What is equally relevant to the current claim stated above is that the Gaussian theory (vide 
Brunt, p. 34, 1. 4) presupposes the existence of a true value as a foothold for any meaningful 
definition of error as such. Within the framework of its assumptions this true value is the 
arithmetic mean of an infinite number of trials. It is important to realise that this is the only 
consideration relevant to a justifiable identification of the mean with the expected value. The 
interchangeability of the terms in current statistical writing (including this book) is misleading 
in any other context. Outside the Gaussian domain, the mean—like the variance—can claim 
no special semantic status in preference to other parameters more or less usefully invoked in 
the formulation of sampling distributions. 


CHAPTER 18 


ELEMENTS OF ANALYSIS OF COVARIANCE 
AND OF FACTOR ANALYSIS 


18.01 REGRESSION AS A STANDARDISING DEVICE 


IN Chapter 17 we have seen that the least squares estimate of the constants of a linear law has 
a long history in the so-called exact sciences. On that account the concept of a physical law 
has cast—and still casts—a long shadow over the statistical theory of regression as applied to 
biological and sociological enquiries. From the viewpoint of the physicist, two issues are of 
paramount concern: (a) are the data of an experiment consistent with the coexistence of 
unavoidable experimental errors and of a law suggested by the data themselves or (and more 
often) by a particular hypothesis from a cognate domain of enquiry? (b) if so, what are the 
most reliable estimates of the definitive parameters, e.g. an elastic modulus or the E.M.F. of a 
standard cell ? 

"Тһе second question has in fact little meaning unless we predicate what is implicit in the 
statement of the first, i.e. that the major source of variation arises from random error of observa- 
tion, instrumental or personal. As we have seen, this is rarely, if ever, true of situations which 
arise in sociological enquiry ; and it is by no means always true in the domain of experimental 
biology. If we plot sociological and biological data in conformity with the traditional technique 
of least squares, we rarely do so to prescribe a figure comparable to a physical constant. We 
do so to decide whether some putative causal agency exerts a real influence or merely whether 
there is some causal nexus responsible for concomitant variation of different score sets. 

The student will experience little difficulty in appreciating this shift of interest, if we here 
digress to discuss a typical situation in which the biologist may invoke the technique of regression 
with more or less advantage. We shall suppose that we are investigating the response of 2 groups 
of animals on a different diet to one and the same drug. We have then to take stock of the fact 
that individuals of different size will not respond equally to the same dosage of the drug. In 
the absence of any diet effect, the administration of the same dose to each individual might 
therefore result in a group mean difference, since it would very rarely happen that the mean 
weights of the groups would be identical. The investigator can sidestep this pitfall in several 
ways : 

(a) by choosing animals of so nearly the same body weight that any such source of variation 

would be trivial ; 

(6) by pairing off individuals of nearly the same body weight in each group and by giving 

each pair the same dosage ; 

(c) by pre-adjustment of individual dosage based on previous knowledge concerning the 

relationship of dosage itself to body weight for a response of fixed magnitude ; 

(d) by using information gained in the course of the experiment to adjust the figures 

accordingly. 

The first is the ideal of the worker at home with his materials; but is sometimes im- 
practicable. Some combination of (5) and (c) is then the best course to pursue ; and (4), which 
is a pis aller in laboratory enquiry, raises issues we shall explore more fully in connection with 
the technique known as Analysis of Covariance. Essentially, the latter is a battery of significance 
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tests ; but we can most easily understand the current claims for what they do test, if we consider 
the relevance of information embodied in a regression equation to (c) and to (d). 

In many situations, it will suffice to act in accordance with the assumption that response 
is directly proportional to dosage per unit body weight or per unit surface area in the range 
of size variation imposed by available stocks; but it may be desirable to make a more precise 
adjustment or, at least, to test how much error such a procedure entails. The pilot investigation 
of the relationship will then be reducible to 2 variables, if it is practicable to produce a response 
of fixed magnitude by varying the dosage administered to one and the same individual. We 
may then plot values of the requisite dosage against body weight for individuals of different 
size. If this is not practicable, the aim of the enquiry will be to express the magnitude of the 
response (r) in terms of the joint variation of dosage (4) and body weight (w). Should this 
relation be linear, it takes the form r = k,d + kaw + С. We thus have all the required informa- 
tion to prescribe the correct dosage to evoke a fixed predetermined response, if we know the 
weight of the animal and the numerical value of the 3 constants in the equation. 

'The situation last mentioned involves the technique of multiple regression dealt with in 
17.07. Here our concern will first be with the simpler case involving the relation of only 2 
variables. When the relation is exactly linear, this takes the form d = Адто + С; and the 
procedure for evaluating its slope constant (gy) is one with which we are now familiar. The 
numerical value of the constant (C) definitive of the origin in terms of the d-score and w-score 
means of our pilot enquiry then follows from definition. In our customary notation, 


E, | Ea. (d) = kaw . E(w) + C, 
eM = kaw. Mo + C, 
a лым о uh d 


When the relation is approximately linear, we may write the regression score (elsewhere denoted 
х,. а) in the form 
dp. = Е.ә + С. РОУ |) 


Example 1. Regression is exactly linear for the following fictitious set of observations involving 
weight (kilos) and dosage (milligrams) for a response of fixed magnitude : 


w d dw w? 
2 12 24 4 | 
5 14 70 25 | 
8 16 128 64 
п 18 198 121 
Totals 26 60 420 | 214 
105 agı 


Means | 12 15 


"The required linear relation is therefore 
а= 0 + 16); C — 106. 
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Example 2. For the following figures regression is roughly linear: 


"Total 


w d ао wo? Observed d Calculated d 
| 3 | 9 27 9 9 10 
3 10 30 9 10 10 
4 11 44 16 11 10-7 
Б 13 11-4 
| 12 1275 
| 


Having conducted a pilot enquiry involving p paired observations to evaluate the constants 
in (ii) above, and this will, of course, commit us to a test of linearity, we can state the approximate 
margin of error entailed in assigning the correct value to d by recourse to the formula of (xxi) 
in 17.04, viz. : 

(w — Mu) 
P-Vo 


1 
Р iii 
{++ (ij) 
If we denote the actual dosages for a given body weight in the standard graph of our pilot experi- 
ment by di we define s; for p paired values in all and c different values of w in accordance 
with (xv) of 17.03 by the equation 

т ај а 

бат. > D (di; — d,.)* z 5 : . (v) 

P— 2521521 

By recourse to (iii) and (iv) we can assess the legitimate confidence with which we may 
adjust dosage to body weight in advance in accordance with (c) above. The end in view is 
characteristic of numerous situations in which it is our concern to eliminate a known source 
of variation otherwise likely to vitiate a judicious evaluation of another; but the task does not 
always admit of disposal by recourse to results obtained once and for all by a pilot enquiry of 
the sort illustrated above. In some circumstances the existence of an additional contributory 
source of variation may not be apparent beforehand, It may then be possible to be wise after 
the event. If we do suspect the existence of a second source of variability irrelevant to our 
end in view, we may design our experiment to provide us simultaneously with sufficient informa- 
tion about its contribution to justify a confident answer to the main question. 

When our concern is indeed to evaluate 2 or more sources of variation within the frame- 
work of one and the same set of observations, it may happen that each (e.g. dose and size or 
percentage literacy and family income) is expressible quantitatively by reference to a system 
of scores, and that each is conceivably contributory to a quantifiable response (e.g. hours of sleep 
or infant mortality). If so, we may separately assess their effects by the method of multiple 
regression (vide 17.07) or, in a less satisfactory way, by recourse to partial correlation (vide 
9.04 in Vol. I). In the symbols of an earlier paragraph (p. 765) our empirical regression 
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equation connecting response with two other variates such as dosage and body weight is 
r=hkd+kw+C. Our statistical problem is whether k, and ką each (or either) significantly 
differ from zero, i.e. whether we increase the precision of our estimate (7) by including both d 
and v in the equation. 

If one source of variation (e.g. hair colour) is conveniently expressible only in qualitative 
terms, neither of the procedures last named is applicable, and we have to employ some other 
means of summarising our data in a form exhibiting the separate effects of the relevant variables. 
It is customary to speak of such refined summarisation as standardisation ; and it may help the 
reader to appreciate the use of regression as a standardising device if we here recall a method 
of standardisation commonly used in vital statistics, especially to forestall erroneous conclusions 
suggested by comparison of crude mortality or crude morbidity statistics of communities of 
different age composition. Needless to say, the risk of death or disease differs widely at 
different ages. Consequently, mortality or morbidity rates of two different populations may 
differ considerably if one has a very high proportion of very old or of very young persons, 
and the other a very high proportion of individuals in middle life. "There is a simple way of 
taking stock of this difference, if we have access to the appropriate rates separately recorded 
for different years (or other appropriate interval) of life, and if we also know what is the pro- 
portionate contribution of each such age group to each total population. We then proceed as 
follows. We first construct a population of standard age structure preferably based on an 
average figure for the test populations, e.g. by pooling the number per thousand per corre- 
sponding age group and dividing the total by the number of test populations. We then calculate 
what the mortality or morbidity rate would be if each test population had the same age structure 
as the standard one, i.e. by weighting the appropriate rate for each age group in the test 
population by the proportion of persons of the same group in the standard one, the weighted 
total then being our standard rate. 

One use of regression is essentially like this. We might rely on our previous illustration 
to exemplify it; but it will be better to consider a situation in which its use is more plausible. 
Accordingly, we shall suppose that we cannot easily control the food intake of the test animals 
(rats) of 2 groups (I and II) which respectively receive the same ration with (I) or without (II) 
addition of a small fixed quantity of an ingredient of negligible calorie value, our aim being to assess 
the effect of the latter on growth (i.e. body weight increment during a fixed period). In such 
a set-up we might have reason to suspect that the rats eat more on diet II, and our figures may 
confirm this, if we record the total (or mean daily) food consumption of each animal. Since, 
as our figures for rats on one and the same diet will show, growth depends on food intake, we 
have then to distinguish between two possibilities : (a) the only effect of diet II is to stimulate 
the appetite of the rat; (b) diet II has also a specific effect in the absence of any increase of total 
food consumption. A specific effect in this context may signify either (or both) of two group 
differences: (i) the group means, and hence the value of the constant C in (ii) above, are 
different ; (ii) the group regression constants are different. If the group regression constants 
are identical we shall say that regression is uniform, and we shall postulate that this is so in 
what follows next. 

Now our figures for a short fixed period may well show that regression of growth (хь) on 
food intake (x4) is approximately linear and we shall assume that this is so. For simplicity, 
we may first assume that the linear relation is exact, and on this assumption we shall examine 
the consequences of the hypothesis that diet II has no specific effect. If this is so, we can 
therefore express the relation between growth and intake of both groups by an equation of the 
form 

= A E . 5 z К 5 5 (v) 
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112 4 6 8 ю R 4 16 в 
Fic. 123, Linear Regression. 


This figure refers to three sets of paired scores exhibiting an exactly linear relationship. 


I ш 


"The determination of the regression lines from the appropriate statistical parameters is as follows : 


6(259) — (35)? 329. 6(868) — (35130) 658 , — 658 , 
Group I. V, 36 36 Cov (а, b) 36 36 kya EST 2; 
с=м, — &,M, = 19 — 89 10, 
6(674) — (60)? _ 444, 6(1948) — (60)(180) _ 888, 888 
Group II. V, 36 36} Cov (a, b) 36 36} 743472: 
C — M, — M, = - = E 10. 
6(952) — (72): 528. 6(1184) — (72/84) 1056, — 1056 ,. 
Group III. V, 36 3g ^ Cov (ab) 36 36 i hyo = т = 25 
C — M, — &,M, = ” 10. 
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We may denote the corresponding means of the two groups by Ma. М„.» and М». My.» 
By hypothesis, kya. ı = koa = Аа. 2, i.e. the regression coefficients are the same for each group. 
Hence we have 


М, koe Mea = C— Mya Rue Mes з з 0s (vi) 


Within the framework of the foregoing assumptions, i.e. that regression is linear and that the 
regression coefficients are identical, the two B-score means defined by (vi) will therefore be 
equal if, and only if, Ma.ı = Ma. Thus they will be the same if each group experiences 
the same food mean intake (M ,4) as the pooled assemblage of both groups. We may therefore 
define standardised (or adjusted) means (M,,., and M,,..) by the relations 


May. = һы. Msa + C= М.з. 
From (vi) above 
Mai—MyichE(Ma—M,.) . - «© © (уй) 
Similarly 
Myy.2 = М.а + ЊМ, — Ma. 2) . . ‚ (viii) 
The standardised group mean growth score is therefore obtainable by adding to the crude 
group mean the product of the group regression coefficient and the difference between the food-intake 
grand mean of the pooled sample and the group food-intake mean. 
Let us now suppose that diet II does have a specific additive effect in addition to its non- 
specific action on appetite as shown by the fact that M,,.. > Ms».ı If we denote as F, the 
growth increment due to this specific food factor, our equations of score components become 


хь.у = koa- Xa. С and xy a = А.х... + C+ Fe 
^ Мь.а= ka. Mat CHF =Ma tF. : Я = (ix) 


If diet II has a specific effect, the standardised group growth mean will therefore be greater 
than that of group I. A numerical example will assist to clarify the foregoing arguments. 


* * * * * * 


Numerical Example. Table 1 shows 3 series ot p ( — 4) paired scores, regression being exactly 
linear for each series. The reader may check as an exercise the values given for the regression equations 
(b = За + 5) which are identical for the first two series. The slope (kya = 3) for the third is the same 
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TABLE 1 
Series I Series II Series III 
а? | 
а b ab | at a b ab a b а | a 
4 17 68 | 16 8 29 | 232 64 9 37 333 | 81 
5 20 | 100 | 25 9 32 | 288 81 10 40 | 400 | 100 
7 26 | 182 49 10 35 | 350 | 100 12 46 | 552 | 144 
10 35 | 350 100 12 4l 492 | 144 15 55 | 825 | 252 
Totals | 26 98 | 700 | 190 | 39 | 137 | 1362 | 389 | 46 | 178 | 2110 | 550 
My = 445; Кы = 3 
M, = 115; C = 10 
b= За +10 


I, II, III pooled (p = 12) 


Total 


579 | Total 


My = 29:375; kya 


М, = 34-42; (y, = 3:44) ; 
М, = 8:125; C = 5; b= Sa +5: M, =925; (C26) .... 


as for the other two, but the origin (C = 10) of the distribution is different. This is equivalent to adding 
a specific factor F, = 5 to each B-score computed from the regression equation of the other 2 series. 


If we pool I and II, we obtain the pooled mean M, = 8:125, whence we arrive at the following result 
(Table 2) : 


TABLE 2 
M, crude My standardised 
I 24-5 245 — 3(6-5 — 8-125) = 29-375 
п 34:25 34-5 — 3(9:75 — 3-125) = 29:375 


If we now standardise the scores by reference to the value of M, (= 9-25) for the entire pool of 
data, we have 


М, crude M, standardised 
I| 245 | 245 —65 — 925) = 32-75 | 
u| 3425 | 34-25 — 3(9-75 — 9-25) = 32-75 
m| 45 | 445 — 311-5 — 9-25) = 37-75 


* * * * * * 
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"Thus the standardised B-scores for the first 2 series of our numerical example are identical 
whether we standardise them for comparison with one another alone or for comparison with 
the third. The standardised A-score for III exceeds them by the series factor (F; — 5). This 
must be so, as we see if we write the equations 

b, = ka, + С За +5+0; M,.,—3M,.14- 5; 
b, = kaas + C =3a,+5+0; М№..=3М,..+ 5; 
bs = һа; + С + Е, = За, +5 +5; М.з = 3М,.з + 10. 
Whence the standardised mean B-scores are 
I. My. — (M,., — Mj) = 3M... + 5 – З(М,.; — Ma) = 3M, + 5. 
IL М. — (M,.. — Ma) = 3Ma.a + 5—3(M,., — Ma) = 3M, + 5. 
Ш. M,., — З(М,.з — Ma) = 3M, .s + 10 — 3(M,.3 — M.) = 3M, + 10. 

In terms of assessment of treatment we may sum up the foregoing remarks about standardisa- 
tion as follows. We suppose that we have before us, for each of several treated groups, paired 
values of the responses (5) of different individuals and of some correlated score (a). Our A-score 
means vary from group to group and our aim is to assess how far this circumstance suffices 
to account for the treatment group mean differences w.r.t. the response itself. In the absence 
of any residual source of variation, we may say that 

(i) group means adjusted by the method described above will be identical, if treatment 

per se has no effect ; 

(ii) if treatment exerts an independent specific effect, being then such as to shift the origin 


of the regression from C to C + F, its influence will appear as an increment (or de- 
crement, if F is negative) numerically equivalent to F. 


In biological and sociological enquiry, it is, of course, impossible to exclude residual sources 
of variation affecting the responses of individuals or communities; but we can sometimes 
justifiably assume that their collective effect is random in the sense that positive and negative 
deviations from the regression mean resulting therefrom cancel out in the long run. In practice, 
therefore, standardising our data by recourse to the regression equation is unlikely to yield 
adjusted means which are exactly equal when treatment has no effect. What it can do is to get 
the meaning of the crude data into sharper focus. If the effect of standardisation is to reduce 
the group mean differences very noticeably, we have reason to suspect that the residual differences 
are attributable to random residual variation, being insignificant in that sense, Having removed 
the effect of the uncontrolled variable A, we have thus to ascertain whether the residual variation 
is still accountable without invoking the assumption that treatment is efficacious. This is the 
major objective of the statistical technique known as analysis of covariance. 


18.00 ANALYSIS OF COVARIANCE 


The need for a technique such as analysis of covariance arises in circumstances when : 

(a) we wish to determine whether some qualitative criterion of classification, e.g. treatment, 
significantly contributes to the variation of a score B, e.g. gain of body weight ; 

(b) we also have reason to believe that the score B depends in part at least on another 
variable A, e.g. food intake, which is not under direct control and is therefore inconstant 
w.r.t. groups distinguished by the criterion of classification and unlikely to have the 
same mean value in any two of them. 

12 
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When it is not indeed possible to eliminate the effect of such variation a true effect associated 
with the criterion of classification si; s that the relation between A and B in different groups 
is not the same. If we can score A so that regression of B on A is linear, a true difference may 
show up in either or both of two ways : 


(i) regression is not uniform, i.e. the regression coefficients are not all identical ; 


(i) there is a specific and group effect, i.e. regression lines do not have the same origin. 
For either or both reasons the adjusted means will in general be different. 


To assess the significance of adjusted means we thus need two different tests which bear 
directly on the issue raised above ; but the performance of either presupposes that we can safely 
assume regression within the groups to be linear. This would raise no new issue, if we were 
free to pick and choose our A-score values, as we can do when they are amenable to direct control ; 
but if so, we could design our enquiry without raising the problem we now face. Otherwise, 
the test for linearity based on (xiv) of 17.04 may fail us, because the F-ratio is indeterminate 
when each different B-score value within a group goes with a different value of the A-score. 

In laboratory practice, we shall rarely be concerned with comparison of more than 2 treatment 
procedures at once, but in certain types of trials it may be advantageous to deal with more than 
two groups of paired scores. We shall therefore regard the comparison of 2 groups as a 
particular case of a more general pattern. We may visualise the lay-out (Table 1) for 3 groups 
as below: 


TABLE 1 
Group I п ш 
А B A B A B 
ei [Ж ал bia аз ыг 
азд bis аз baa аы bis 
dis ba as. Bas 
denn аљ bes 
| Au Lo bse 
Means Maa [и Муз. |) Dare | MERE 
| 
No. of 
paired 5-3 һ=4 
scores 


The essentially new question such a table prompts us to ask is whether there is a group 
effect. If so, we may also ask, is this because regression is not uniform or because the group 
effect is additive if regression is indeed uniform as defined above ? It may also be useful in 
certain circumstances to refute the suspicion that variation w.r.t. the A-score per se contributes 
anything appreciably to variation w.r.t. the B-score. This calls for the addition of another 
test to the battery. The entire battery of appropriate significance tests is a sequence in which 
the answer obtained from one decides whether it is worth while to ask the next. We may list 
them in this order : 
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(i) if regression is linear is there a group effect of either sort ? 

(ii) if so, is regression uniform from group to group ? 

(iii) if so, is there an additive group effect ? 

(iv) is there true within-group regression ? 

The logical order of procedure is a little puzzling to the beginner to whose difficulties the 
practice of exhibiting it against a background of elaborate computations adds needlessly. The 
necessary computations for the tests are very laborious, and the arithmetical order of procedure 
involves short cuts which have nothing to do with logical precedence. It is permissible to 
wonder how any student first confronted with paradigms chosen from agricultural trials or the 
like can hope to emerge from such a maze with any clear conception of the framework of assump- 
tions relevant to correct application of the technique. 

As in the foregoing examination of significance tests for regression estimates, the procedure 
prescribed is : 

(i) to formulate independent estimates of the true variance of the putative common universe 
of e-score (residual) components with a view to the use of the F-test in accordance 
with principles by now familiar ; 

(ii) to employ as the denominator of such a variance ratio (F) a yardstick statistic which 
necessarily depends on residual variation (o?) alone ; 


(iii) to employ as the numerator of the F-ratio a statistic whose expected value will exceed 
9; if the null hypothesis is false. 


In what follows we proceed in the same way with this qualification. It may happen that 
we can formulate an independent statistic whose expected value will be /ess than that of 
the yardstick statistic if the null hypothesis is false. To use the F-table intelligently we 
must then employ the former as the denominator of the F-ratio and the latter as the 
numerator. 

Notation. In defining appropriate expressions for the numerator or denominator of the 
F-ratio, we have had to assume that we are sampling in accordance with the principle of the 
fixed-A set. In this context, the principle presupposes a doubly stratified universe, since we 
have to assume that the A-score distribution is fixed for each set of paired scores as in the sample. 
If this is clear we may drop the subscripts c and s except when we need to distinguish the true 
value (kss) from the sample value (/,.. с) of the regression coefficient. Our code will be as 


follows : 
Pooled Sample Within the kth sub-sample 


No. of paired scores . Я : : р Pr 
Mean A-score . A Я 5 3 M, M. 
A-score Variance , Я : i V, Va.: 
Mean B-score . " n е а M, М,., 
B-score Variance А a E 3 V, Vo. 


For Л sets of paired scores we may designate the operation of extracting a mean value as 


1 $z R 
А EC SE s) 


= 1 
- p.n (br) =p-—ch and р. z(=) =W 63. AE 
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For the operation of extracting the within-set mean of all p, values we may likewise write 
чер, 


ЕЕ 


u=1 
For the expected value of a parameter W within the fixed-A set as a whole we shall use E,(W), 
so that the expected value of the mean e-score variance within the set is 
Ey. M(V,.)) = E, EV e. 1) = Ey EKV 0.1), 


EX: ЖШ T 
ESAME, А 4) Loon 
Рһ Р 
To complete our code we must make explicit the putative components of the B-scores. 
1f there is uniform regression and no group effect associated with our qualitative criterion of 
classification, i.e. all sets of paired scores come from the same bivariate universe, we may write 


=e+F,4+C. 


If there is a group effect either F, or C varies from group to group, indeed both may do so ; 
and we may distinguish 


Ь=е-- Е, + С, regression uniform, additive group effect present ; 
b=e+ Fanat С regression coefficient variable from group to group, no other group 
effect ; 

Ь= е -- Fa.n+ Сһ regression coefficient variable and additive group factor present. 
If regression is also linear we may write F, = kya . a or Fa. n = kya. n. @ іп the above, as the 
case may be. The accompanying table of B-score components (Table 2) fills in any essential 
gaps. By reference thereto we can at once derive a result which will clarify subsequent reasoning. 
When / sets of paired scores come from the same bivariate universe, we have before us Л paired 
mean A-scores and mean B-scores ; and we may define in the usual way a coefficient of regression 
of the mean B-score on the mean A-score. The expected value of this coefficient (Ay...) is the 
true regression coefficient (kj). This is deducible from the following considerations. If 
regression is linear and uniform, in the absence of a group effect 

My n= М... + hM, HC; 
Cov (Ma, My) = E{ Ma. n — Mj))M,. n 
= E Ma. n — „Мм, at koa. Ex(Ma. x — a) Ma. w 
In thisfexpression 
E (Ma. n — Ma)Ma. n = E(Mz.5) — М„Е,(М, . n) = EM;. n) = М = VW(M,.5); 
Cov (Ma, Mz) = E Ma. n — М,)М,. + Roa. V(Ma. a). 
The expected value of the first term on the right, being the covariance of the mean A-scores 
and the mean of the independent residual e-scores, is zero and within the fixed-A set : 
E, . Cov (Ma, Mi) = kra . V(M,. 1). 

If А... is the observed sample value of the regression coefficient of the mean B-score on the 
mean A-score : 
_ Cov (Ma, Mi) 

V(M,.») ' 


» Elks. =n CENE - + Ш) 
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Meaning of Parameters. We have already seen that it is possible to split the variance of the 
B-score distribution into two components, of which one depends on error variation alone when 
regression of B on A is linear. The hypothesis that all our p paired scores come from the same 
bivariate universe in which regression is linear thus implies 


Bl = Yaoi „жЩ Фи 
We may thus define as follows a statistic whose expected value will be o7 if regression is uniform 
and linear, no group effect being present : 


EAs) = 02; $= 525 &$-ü-me.W . . .Q 
Now we have before us also л paired mean scores from which we can derive the regression 
coefficient &,,., of (iii) and the corresponding correlation coefficient r,. Within the framework 
of the foregoing assumptions, we can therefore obtain an unbiased estimate of o7 from the 
statistic (1 — 72)V(M,.,). The form of this statistic is deducible from the build-up of 
(1 — 73,)V,, which we may write as 


(1 — ÈV + ть. Vo = Vy = Va + E. Vs 


Similarly 
(1 — 75)V(M,. a) ++». У(М». a) = V(M,. a) + Ej - V(Ma. a). 
In this expression 
(1 — RVM. a) = V(M,.)) = Ve — М(У,. а). 
Now we may write 


Si 
E,. MV,..) = Е,.ЕДУ,. а) = e (e y 


А Eee MV.) ta 


Whence from (iv) 


—2, —h h—2 
EQ — EVM.) =Ê ? 


оў оў} 
Po 2t MED 
Within the same framework of assumptions, we may therefore define an unbiased estimate 
of o? by the relation 


E(s)—o s 


с . (s) 


S 
h—2’ 
Within the groups, linear regression implies 

Edt — à Vua PO of 


k 


Sa =(1—)р.И(Мь.) - . . (vii) 


Whence from (i) above 
pa 


RMU Daa - о? ne. „(шй 
Accordingly, we may define a third unbiased estimate of оу by the relations 
S, ; 
Ess) = 02; 8 iy 53 = М(1 — riab- Von . . - (ix) 


p—2h' 
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The expected value of the statistic (sł) depends neither on the assumption of uniform 
regression (kpa. n = ksa) nor on the assumption that there is no group effect (C, = C). If 
regression is uniform, we may indeed obtain a fourth statistic whose value does not depend on 
the existence of a group effect by using the square (75, „) of the mean within-group correlation 
coefficient for the mean square M(rj,;) of the within-group correlation coefficient in (vii). 
We define 72, „ as follows : 

„2 _ ТМС (a, Вр 
U^ M(Va.r)M(Vo. y) 


[M Cov (a, Б}? 


` Tam- М(Рь. а) = Ma oa a a xx) 


M(Va. a) 
"Thus the statistic whose expected value we shall now determine is 
3 5, 2 Р 
М(1 —т>».„)Ў».»= 7j M(Vi.1) — T.m MCV o.a) + : „= (x) 


In this expression uniform linear regression implies 
M(Vo.) = MUO a.a) + Ki - M(Va. a). 
Whence within the fixed-A set from (ii) 


E,. M(Vy.)) =” QOA.MQ.a) «0s s s (ii) 
In (x) above, 
M Cov (a, b) = M Cov(a, e) + kra . M(V,. һ), 
[M Co (a, e)]* 
M(Va. a) 
In this expression the last term, the coefficient of the covariance in the second term and the 


denominator of the first are constants of the fixed-A set. Since the expected value of Cov (a, e) 
is zero, we may therefore write 


ete Tas.m- M) = + 2ky, . M Cov (a, е) + ®„. M(V,. n). 


ЕМ Cov (a, е)]? 


Е,.12,.„· M(Vo. 2) = М...) 


TR. M(Va. а). 


Whence from (xii), if regression is uniform, 


Ед — 4,0). MV.) e ER og BM АЫ» (xii 


P M(Va. n) 

To evaluate the second term on the right it will be convenient to put М. Cov (a, е) = О, 
so that E(Q)-— 0. By definition of variance, we may therefore write EQ") = LoT. 
Zm = Cov(a, е) within the mth set : 

mah 

MCov(a,e)=O= X Pa am 

m=1 
Each component Zm of О is independent of any other, being referable to different sub-universes. 
Hence if o? „ is the variance of the distribution of Zm, 


с^ 
ЕДМ Cola o =R= 2 RÀ. 0 . 0089) 
m=1 
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In accordance with (v) and (x) of 17.03 
Zm = (kra. cs — koa) Va -m 3 


o; оу. F, 
5 Д р2 2. Уа. т 
z ылын т) = 
Whence from (xiv) 
= 
= "Vam 
Ssp 2, P 


~. E, [M Cov (a, 6] = z M(Va. э). 


Thus from (xiii) above 
p—h-1, 
Е(1 = raa) М.) = ——% л s : e (xv) 


We may thus define a fourth statistic which is an unbiased estimate of oz if regression is uniform 
and linear regardless of the presence or absence of a group factor : 
S. 
p—^—1' 
We can combine S, of (i), Ss of (ix) and S, of (xvi) to obtain other statistics which are 
unbiased estimates of o7 on the assumption that 


Els) = 0; s Sa = (1—%ь)р.М(У„) . (к) 


(i) regression is linear 


Е(3) = 02; s xt 3; $—58—$ . . . (wi) 
(ii) regression is linear and uniform 

Е(%) = e; i-i: $,—5,—5, fy xvii) 
(iii) regression is linear and uniform, no other group effect 

E(s) = 085 si i $,— $,— S, UE is) 


In specifying the assumptions subject to which the several statistics defined above are 
unbiased estimates of o2, we have not indicated what is of pivotal importance if we wish to 
prescribe an F-test in accordance with the procedure outlined above. Of those defined by the 
foregoing equations, s? being referable exclusively to variation within the group is an unbiased 
estimate of o? whether regression is uniform (kya. a = ksa) or not and whether there is or is 
not (C, = C) a group effect involving a shift of origin of the score distribution. It is thus the 
fundamental yardstick statistic ; but if we are content with the outcome of a test of uniformity 
based thereon, we may proceed to use sẹ as a yardstick statistic. The effect of variation among 
the values of 74». , will be to make the expected value of the square of the mean within-group 
regression coefficient (r>.m) greater than it would otherwise be. We may therefore write 


regression linear and uniform E(s) = E(s) ; E(Se) = E(s). 
regression linear, not uniform E(s,) > E(s); E(s) > E(s). 
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The statistic sj of (iv) being referable to (1 — r?,)V,, will diminish if the set-up is such as to 
increase the expected value of the common ra». Either differences of the regressions inter se 
or an additive group factor will make the latter greater than otherwise, whence we can write 


regression linear and uniform, no additive effect:  E(s;) = E(s;); E(s;) = E(s;) ; 
regression linear with one group effect or both: E(s5) < E(ss) ; 
regression linear and uniform with additive effect: E(s;) < E(s,). 

This leaves us with s? which depends on the regression of the paired mean scores. Like 
sj its value depends on variability of both regression coefficients within groups and the presence 
or absence of an additive group effect. Either sort of group effect will diminish its value. We 
may therefore state 

regression linear and uniform without additive effect: E(s2) = E(s3); 
regression linear and uniform with additive effect : E(s,) < E(s,). 

If we have reason to ask whether there would still be a significant correlation between 

A and B in the absence of a group effect we may confine our attention to the fraction of total 


variance which is not affected by either sort of variation which may arise from the group classi- 
fication, viz. M(V,.,). If there is ло within group regression, we may then write 


Eds) = o; ue ps Sa = Sos.» = р. M(V,.)) in Table 3 . (xx) 


Thus we have 
Ез) = 00; = 5—5 =ль„р.М(И„) «00 (хх) 


We have now all the requisite statistics of the battery of tests outlined above, and may 
proceed to define an F-ratio based on two statistics whose expected values are identical, if the 
null hypothesis is correct, choosing as the numerator the one whose expected value must be 
greater if the same hypothesis is false. The proof that they are independent Chi-Square variates 
follows the familiar lines set forth in Chapter 16 and in 17.04. 


(i) Is there a group effect of either sort ? 


s Ss 2h—2 
Fy = 3 = — a 8 xxii 
® з p—2h S,—S, c 

(ii) Are the within-group regression coefficients identical ? 

5 _ 5—5, p—2h es 
Fes visis epu e (xxiii) 

(iii) If regression is uniform, is there an additive effect ? 
Fy = 5 E bed (xxiv) 


4771-1 878 
Alternatively (for confirmation) 


(xxv) 
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(iv) Is there regression not attributable to group effect ? 
SiS NUEVE m Gey 


(Ss = Sob- w in Table 3). 


Note on Computations, Table 3 is a key to the appropriate sums of square deviations and 
As in 17.02 above, it simplifies machine 


products of deviations from the relevant means. 
calculations if we sum.5 columns for each block of р, paired scores : 

Sec And dim total raw scores within block ; 
total squares within block ; 


Saaw and Soy. 
total products within block. 


Sad. w 
We may write the corresponding grand totals for the p paired scores of all the л blocks as sa. o 
So- or Saa- os $55. o ANd Sab. ,. We then have 


$ s е 
$ а.о = Saa. w — 2; Ѕъ.ю = б.н 9 0. 0. 0. — (xxvii) 
w Pw 
5 A me 
Бш. = ао gH Sov. 0 = fe — 5° J Е . (xxviii) 
Ses. o = Sat: v E 5 Sane = 4:6 == . . (xxix) 


The statistics embodied in S, are obtainable from the grid tautologies of 11.05 and 11.06, viz. : 
V = M(V) + V(M); Cov (ab) = Cov(M,M,) + M Cov (ab). 


Thus we have 
Scam = Sea-0— Saa. p5 З.т = Sy. o — ы.» (xxx) 
Sav.m = Sav. o — Sav.» \хххї) 
We may, however, use this relation as a check-up, if we compute directly 
woh 2 
Res Ex... 1. s (ad) 
wai Pw b 
wah 2 
Suc > ее "P (xxxii) 
wal fo b 
w=h 
‘Se pape. Sa-0+Sb-6 ‚ ; " . (xxxiv) 
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Numerical Example. The table below exhibits three blocks each of six correlated variates a and b 
with corresponding squares and products for purposes of computation with totals at the foot. 


25 200 64 625 12 37 444 | 144 1369 
34 | 408 | 144 | 1156 | 13 37 481 | 169 | 1369 


TABLE 3 
Group I Group II | Group Ш 

a | b | a | a | B j| a a b ab | а? | b 
2 13 26 4 169 3 20 60 9 400 7 3 21 49 9 
FEM erra et 9 | 289| в | 25 | 150| 36 | 625 IP 32| 64 16 
5 | 21 |105 | 25 | 41| 9 | 29 | 261| в | 81 | п | 12 | 132 | 121 | 144 
6 22 132 36 484 11 35 385 | 121 1225 13 17 221 | 169 | 289 
8 

2 


15 19 285 | 225 361 
26 468 | 324 676 


8 
Е 
8 
8 


282 sie] 54 Е | 1781 | 580 | sem 72 | 81 | use | os 1495 


Below we derive the appropriate sums as set out in Table 3 (Key for Computation) above. 


Group I Group II Group III 
‚ые o . 66 74 88 
T E . 260 247-5 401-5 
S ec ESO 134 137 
Scam = 108 Som 867 Stam = — 153 
Saa.o = 336 Sy, = 1776 80... = 298 
5,4.» = 228 Sw.» = 909 Sy, 451 
298)? 153)? 
5, = 1776 — © = 1512; s = 867 — 189? = 650 
= [260 — (130) шын 15 US Sig: 
5, = [260 766. + | 247-5 74 + |401:5 88 213) 
2 
5, = 909 — SUF э 17; p= 18; A= 3: 
Whence we have 
Ё 1512 — 13 12 
@ Fog =. 52845. 
17—13 12 
(ii) Fe = 5 18 = 186 
E 1512— 17 14 
(ii) Fa = —2 p 616. 
650 14 Я 
(iv) Fa—7:1 259 


The reader may find it instructive to investigate the approximate relationship which subsists between 
the a and Ё scores in each group (reference to the column totals provides a clue). 


ELEMENTS OF ANALYSIS OF COVARIANCE AND OF FACTOR ANALYSIS 783 


18.03 CAVEAT TO ANALYSIS OF COVARIANCE 


In another context, we have had occasion to remind ourselves that statistical theory provides 
no sufficient substitute either for common sense or for an intimate knowledge of external nature 
variously denominated natural history, clinical experience, intuition and good judgment. It is 
especially important to keep this truth in full view, if we are to assess the value of analysis of 
covariance as a tool of research. In appropriate circumstances, the results of its application 
may be highly suggestive and helpful. It is not an open sesame to all closed doors between 
ignorance and knowledge when the end in view is to assess the relevance of quantitative and 
qualitative putative sources to a particular type of variation. 

At the outset, it is necessary to emphasise (as stated in 18.01) that appropriate design of 
laboratory experiments (as opposed to field trials and industrial experimentation so-called) 
commonly offers a more direct and satisfactory approach to the issue which is the peculiar concern 
of the technique under discussion. While there may admittedly exist circumstances which 
make a putatively relevant quantitative source of contributory variation difficult or even im- 
possible to control in an experiment conducted to evaluate the significance of a second and 
qualitative criterion of classification, it is also true that such circumstances commonly exclude 
the possibility of taking precautions to assess the validity of the assumptions inherent in the 
method of 18.02. 

The tests dealt with in 18.02 are conditional on two assumptions. One is that regression 

is linear. The other is that the residual variation of which оў is the measure is the same for 
all sub-universes. The second we can test, if in doubt, by methods mentioned elsewhere. 
Indeed, the test for uniformity of regression answers the question, as far as it is possible to give 
ananswer to it, if there is no reason to dismiss the hypothesis that there is uniformity of regression. 
The assumption of linearity is not one which we can commonly and conclusively justify in situa- 
tions which compel us to fall back on the analysis of covariance as an alternative to a more direct 
procedure. The reason for this is one we have noted elsewhere (рр. 741 and 742) en passant. 
‘The linearity test of 17.04 breaks down, unless we can arrange matters so that we have more 
than one B-score value for at least some of the A-scores, as we can ensure in certain types of 
experimental design. In the type dealt with in 18.02, we have in fact to take our B-scores as they 
come. 
For both the reasons last stated, it is important to be quite clear about the credentials of 
the claim that statistical tests such as the Gosset t-test and any test based on an F-ratio permit 
us to make assertions with confidence about small samples. Formally, and in accordance 
with our initial assumptions (e.g. normally distributed scores) it is true to say that such 
tests, unlike tests in common use a generation since, rely on the distribution of sample values 
of the parameters of the relevant distribution, in contradistinction to the distribution of ratios 
involving the unknown parameters which we can at best estimate with assurance for very large 
samples. On the other hand, it is necessary to remind ourselves that a significance test of the 
sort under discussion can merely give us a rule for dismissing a null hypothesis without risk 
of doing so wrongly very often. It cannot give us good reasons for believing it, though we may 
indeed have derived reasons from other sources; and a sample, if small enough, may give the 
test rule little chance of dismissing a null hypothesis which is false. 

To the author, the moral of this is clear. If we have before us large sub-samples in the 
set-up of 18.02, we have good enough reason to justify the conviction that regression of the 
B-score on the A-score is approximately linear. In any case, our data may be such as to exclude 
the possibility of checking this assumption by recourse to an appropriate significance test ; 
and in any case, the test does not conclusively prove that the null hypothesis is correct. In 


784 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


practice, therefore, analysis of covariance or any other technique conditional on an assumption 
(e.g. linearity) which we have not good reason to adopt for reasons other than the outcome of 
a statistical test, cannot base its legitimate claim to consideration on the economy of working 
with small samples. 

For a reason stated in 17.06, it may also be legitimate to express some doubt about the wisdom 
of assuming that the analysis of covariance is a reliable tool of research in the concurrent domain 
of sociology and econometrics. Within the consequential domain of agricultural field trials or 
nutritional science, the meaning of the significance tests is clear, and the implications of the 
principle of the fixed-A set—Churchill Eisenhart's Model I approach (p. 548)—present no 
semantic difficulties. It is not equally clear what the Model I approach signifies in the unique 
historical situations of sociological enquiry. 

One other consideration bearing on the judicious use of Analysis of Covariance calls for 
comment; and is on all fours with a limitation perhaps too little emphasised in connexion 
with the parent technique of Chapter 13. We may speak of it as the dilution of the class effect. 
The method of 18.02 is, of course, applicable to situations in which we distinguish only two 
classes of paired scores. When the number of classes is large, there is always a possibility 
that the effect of others will conceal one which is out of step. For this reason, it is a wise 
precaution to calculate within-group correlation coefficients for comparison, and separate investi- 
gation, if the figures are suggestive. 


1804 THe CONCEPT оғ Factor PATTERN 


In different contexts we use the word statistics in several ways, the connexions between one 
and the other use being various and somewhat exiguous. Originally, it signified numerical 
information bearing on the affairs of State; and it is well to remind ourselves of this when we 
examine the controversies provoked by the applications of factor analysis in the field of psychology. 
Factor analysis is a statistical procedure largely developed in connection with what is basically 
an administrative issue, i.e. personnel selection. 'To trace its origins we must go back to work 
undertaken in the nineties by Binet and Simon with a view to devising tests of intellectual 
aptitude with more prognostic value than scholastic examinations. At the start, the yardstick 
of such so-called intelligence tests was their correspondence with teachers' estimates of relative 
ability. As we have seen in Chapter 6 of Vol. I, this is essentially a problem of rank correla- 
tion. The pioneers of test-work explored from this standpoint a variety of puzzles, the general 
knowledge quiz and feats of memory presumptively unrelated to school training. "There thus 
emerged a mass of information about the intercorrelation of test scores. 

Intercorrelation of two test scores in this setting signifies a correlation—rank or product- 
moment—based on the application of each of them to each individual of a group. In the idiom 
of our 2-face card pack model, of 12.00, the individual is the card and the test score is the number 
of pips on one or other face. In that of the Umpire Bonus Model, the individual is the particular 
trial and the test scores are the scores of the players. The fact that the results of say six tests 
of the same individual tie-up in the sense that there is a significant positive correlation for any 
pair of corresponding scores applied to the same, or to a comparable, group of individuals does 
not necessarily mean that they all measure the same aptitude. This will still be true if: 
(a) each test measures a congeries of unconnected attributes ; (b) the results of any pair of them 
depend in part on one such attribute which does not affect those of any remaining test. Hence 
arises the following question: is there any characteristic common to what we are measuring 
when we apply different so-called intelligence tests ? If so, and if there is indeed only one such 
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sort of aptitude, it may be a verbal convenience to adopt the convention of restricting the use 
of the word intelligence thereto. 

The query last stated assumed a more provocative aspect when Spearman first propounded 
what it is customary to call the hierarchical principle embodying a feature of the lay-out we 
may meet when we arrange such test-score intercorrelations in a symmetrical grid. His inter- 
pretation embodied in the concept denoted by g (for general intelligence) started a controversy 
which led to the recognition of more complicated patterns. Factor analysis is the attempt to 
interpret them. At the outset then, let us be clear about what a factor pattern signifies. We 
shall assume that we have before us the results of applying 5 tests (4-Е) to each boy or girl in 
a school form, and that we can therefore calculate the product-moment index of any particular 
pair. Having done so we may set them out gridwise as below on the left. To illustrate the 
meaning of the simplest kind of hierarchical pattern, we shall suppose that the numerical values 
are as shown on the right. 


A B с р Е 

і | A B c D E 
Mop Tas Toe Toa fis A — 044 061 0:53 0:73 
B| ra — The ты Tee B 04 — 036 029 0-39 
С | ree Tre — Tea fos C 061 0368 — 043 0-55 
D | rea „ы Tea — Tae D 053 029 оз — 0-50 
E | rae т, um Tas E E 073 0:39 055 0:50 = 


A close inspection of the figures shows that there is a rank correspondence, which comes 
into focus when we rearrange the items as below on the left. This hierarchical correspondence 
is not the only circumstance the figures suggest. Closer inspection shows that the ratio of items 
in any two rows of one column is roughly the same as that of corresponding items of the same 
two rows in another column. That this is so becomes evident, if we assign suitable border 
factors to each corresponding row and column, expressing the cell entries as their products. 
Thus we can closely reproduce the actual correlation matrix on the left below by multiplying 
factors assigned to heads of columns and row margins on the right : 


A E [^] D B 0-9 0-8 0-7 0-6 0-5 
A| — 0-73 0-61 0-53 0-44 09| — 0-72 0-63 0-54 0-45 
E | 0-73 — 0-55 0-50 0-39 0-8 | 0-72 — 0-56 0-48 0-40 
C | 0-61 0-55 — 0-43 0:36 0:7 | 0-63 0:56 — 0-42 0:35 
D | 0-53 0-50 0-43 — 0-29 0-6 | 0-54 0-48 0-42 — 0-30 
B | 0-44 0-39 0-36 0-29 — 0-5 | 0-45 0-40 0-35 0-30 — 


'The lay-out of the figures of this fictitious example illustrates the simplest type of facto 
pattern, i.e. the hierarchical or single factor pattern for which Spearman first offered a theoretical 
interpretation. How later test results suggest more complex patterns the following actual results 
cited by Burt will serve to illustrate : 
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Composition Handicraft Spelling Drawing Reading Writing 


Composition — 0:30 0-49 0-38 0-58 0-44 
Handicraft 0:30 E 0-09 0-50 010 0:28 
Spelling 0-49 0-09 = 012 0-46 0-25 
Drawing 038 0:50 012 = 013 0-36 
Reading 0:58 0-10 0-46 013 = 021 
Writing 0-44 028 0:25 0:36 0:21 — 


A pattern, suggestive of a hierarchical relationship between a sub-group of this battery 
of tests, emerges when we rearrange the figures as below : 


Composition Reading. Spelling Writing Drawing Handicraft 


Composition — 0-58 0-49 0-44 0-38 0-30 
Reading 0-58 -— 0-46 0-21 0-13 0-10 
Spelling 0-49 0-46 — 0-25 0-12 0-09 
Writing 0-44 0-21 0-25 — 0-36 0-28 
Drawing 0-38 0-13 0-12 0-36 — 0-50 
Handicraft 0-30 0-10 0-09 0-28 0-50 — 


To what extent it is possible to interpret such a pattern as the above with confidence, we 
Shall discuss at a later stage. First, let us examine the rationale of Spearman's hierarchical 
criterion of the single factor pattern. Spearman himself, and many who have followed him, 
relied on reasoning which involves an unnecessary and not necessarily true limitation, viz. the 
assumption that linear regression is itself a necessary consequence of linear concomitant variation. 
On the other hand, our exploration of the Umpire Bonus Model in 12.01 opens the door to a very 
simple derivation of the hierarchical criterion, if we assume with Spearman that the test score 
of an individual is the algebraic sum of independent bypothetical components. "The single 
factor pattern for test scores x,, x», etc., then takes the following form, x, being the common 
component and x, o, x. o, Etc., the specific опе: 


Xa = Ay. xy + Ao. Xa. 03 
Xy = By. xu + Bo. ху. 
Xa = Cy. Xu + Co. Xo. 


Strictly speaking, the assumption of the statistical independence of the two score com- 
ponents is unnecessary. All we require to assume is that their covariance is zero. The same 
is true of the score components in the Umpire Bonus Model set-up. 


18.05 DERIVATION OF THE HIERARCHICAL CRITERION 


The foregoing system of equations definitive of the individual test score are formally identical 
with (vi) in 12.01, the common factor being the umpire’s bonus. For this set-up, we have 
established the following relation specified by (ix) of 12.01 : 


Tab = Tau Tow 
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For a set of 5 players we can therefore write 


Tou Tou Tew Tus Ps 
Tow EE Таъ = Tau -You Tae = Tau -Teu | Таа =Tou+Tau | Tas = Tons Рош 
Tou | Tar = Tau -You m Tre = You -Yeu | Trea = You -Tau Toe = Tou -Teu 
Teu | Tac = Ғам Теш Toe = Tou -Feu Tea = Teu -Yau Tee — Teu -Teu 
Tau | Taa = Tow -Yau Toa = Tou -Tau Tea = Yeu -Tau Tae = Раш Рем 
Teu | Tae — Там Там Toe = Тым - T eu | Tee =Teu -Teu Tae =T au- Ten 
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Given that all five players receive a single bonus from one and the same umpire, we may 
thus lay out the correlation matrix of the intercorrelations between their scores in such a way 
that each cell entry is the product of the two border factors respectively definitive of the p-m 
coefficient of the umpire’s own score with that of one or other player. This establishes the 
conclusion that the single factor hypothesis is a sufficient condition of the hierarchical pattern ; 
but we have still to show that it is a necessary one, i.e. the only feasible explanation. 

Before exploring this issue, let us notice a principle inherent in the hierarchical criterion. 
If we consider any four players of a set of this sort, we notice that we can pair them off thus 
AB.CD; AC. BD; АР. ВС. The products of the intercorrelation of the scores of one 


pair with that of the residual pair are then as follows : 


Tu rus ш Cup ELE 
9.0 OTa [A T 
о oc; ABC DVi. 
Tac: Toa E T CIT 
dE cS MED сі B.C о _ ABCD Vi 
‘ad + The cae ran зая SENS 


Hence we arrive at Spearman's tetrad equations, viz. : 


Tab» Tea — Тае ^ Tra = 0; 


Tay Теа — Taa To = 0; 


Tac + Tra — Tad» Tre = ©. 


Thus a single factor pattern implies that for any 4-fold set of test scores the tetrad differences 
do not significantly differ from zero. In deriving this result we have assumed a strictly linear 
law of the composition of the scores. Let us now examine the consequences of a non-linear 


law for the same model, vis. : 


Xa = AXE. AUX,o; 
Xy = В„Х{ + В,Хь.,; 
X, = CX + С,Х,.,; 
X, = D,X; a5 D, X.» 


We may then write 
Cov (Xa, хь) = E(X? . Xf) = А„В„Е(Х +) 


SABE . X, o) + ABE o X2) FABE Ean Kia): 
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If there is zero covariance between all powers of the two score components and m,,, is the 
th mean moment of the umpire's score distribution, we therefore have 
4 р » 


Cov (xa, хь) = A,B,E(X7**) = AyBy. My + 


Similarly, 
Соо (x, , х.) = AyCy. Main etc. 
We thus derive 
A,B,C,D, 
OL cerca 
0300 
A,B,C,D, 
ЖОМ ee ot he nore 
A,B,C,D, 
Taa- Toe = a Py Mga gy 


Thus the tetrad differences will vanish if, and only if, 
Mora. Mst = Myr s+ Mart = Шум. Mare 


This will be true if p = q = s = t, in which case the law of composition is linear since we may 
replace X?, X7, etc., by Zu 
If two umpires (U and W) contribute to the total score of each player, (xii) of 12.01 prescribes 
that 
Tor = Tau Tou + Taw + Tom CC. j 


с, 
Tau = А"; Taw = Ао", etc. 
Ta a 


Ow 
о, 
Whence we derive 
Tab + Tea = (Тай. Tou + Уаш. Tow) (Teu + Tau + Tow» Tac), etc. ` 
Our tetrads thus reduce to 
Tab « Tea = Taw oul oul au + TawT oul owl aw + Tau? ou еш” aw + Там? >и? еш? дч 5 
Tac + Toa = Taut oul cul au + Taw? owl owl aw + Таш owl oul aw + Taw oul owt au 5 
Tad» Toc = Tau oul сы? au T aul owl cw! aw + Vaul'ow owl au + Tal oul cul awe. 
The first two terms in each of the above are identical. So the tetrad differences will vanish 
only if 
Tau - Tou Tews Taw + Taw: Tow: Teu Tau = Tau + Tou + Tow: Taw F Taw * Tow: Tou: Tau 
= Tau Tau» Tow = Tow F Taw * Yaw + Fou * Tow 
From the first pair we get 


Tau + av(fou - Tow — Tow - Tou) = Taw fav(Tou - Tow — Tow - Tov)» 


Tau — Tau 


Tow Taw 
By pairing off each of the three identities, we thus get 


Tau _ Tou Tou Tau р 


Tow Tow Tew Taw 
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Hence we may write 
Tab = Taw + Toull + K?), etc. 
"This will be true if 


X, = А1 + KX y+ Ay. Х„.„; Xy = BA + КЭХ, + By. Xo. o etc. 
A,X, + А„Х„ = All + K} Xo; BuXu + В.Х, = В„(1 + K* Xu, ete. 


From an algebraic viewpoint, we may therefore say that the tetrad identities are valid for 
a set-up involving 2 umpires only if the composite bonus is replaceable by that of either alone 
with appropriate change of scale. This resolves a controversy concerning how far we are entitled 
to regard Spearman’s g as a single entity. The answer is that it behaves as such in the Spearman 
framework of test material, in the sense that the carbon atom behaves as a unit in the customary 
manipulations of chemical analysis. This does not exclude the possibility that it might behave 
otherwise in a different framework as does the carbon atom under the impact of radioactive 
emanations. 

With the qualification last stated, we can say that the single factor postulate is both a sufficient 
and necessary condition of a strictly hierarchical pattern, as defined in 18.04. If we now fill 
in the empty diagonal cells of our correlation matrix by the appropriate entries, viz. : fho Tho 
etc., each such statistic has an intelligible meaning vis-à-vis our bonus model, i.e. the correlation 
of the player’s score with that of the umpire. We have yet to give these diagonal cell entries 
a meaning in the domain of factor analysis ; and we can do so, if we go back to our model, 
recalling that 

Vom Al. Ve + AS. Vao; 


к SUE 
ies y 


The first of these two equations exhibits the breakdown of the variance of the A-score distribution 
into 2 moieties, one we may call V,, the part referable to the bonus which the players have in 
common, and one У, the part referable to what each player records as his individual score. ‘Thus 
the proportionate contribution of the bonus to the total variance is 


(йз ЫЙ, 
ko 7 


In terms of factor analysis, each hypothetical diagonal entry of the test-score correlation 
matrix when completed is therefore the proportionate contribution of the hypothetical common 
factor to the variance of a test-score distribution. To proceed further, we may simplify our 
problem by assuming that our test scores are standard scores as in 12.07, and that the total 
variance of the test-score distribution is therefore unity. 


= Tau 


18.06 RELIABILITY, ATTENUATION AND COMMUNALITY 


In the real world, no performance test is perfect in the sense that successive applications to the 
same individual would yield absolutely identical score values ; and we may take stock of the 
implications of the imperfect reliability of any test by a simple physical analogy to the Umpire 
Bonus set-up. Within certain limits the law relating the load to the extension of a spring is very 
closely linear, and we may suppose that we apply to each of two springs A and B the same load 
at the same trial and different loads at different trials, the test score (x, , хь) being the length 
of the spring. To apply the test we use a vernier which is fallible like all instruments, and we 
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may therefore regard the test score as having 2 components : (i) its true value proportional 
to the applied force (x,) which varies from trial to trial in accordance with Hooke’s law; (ii) a 
random component x,; so that 


Xa = Ay. x; + Xea and xy = By. x; + хь. 
If we use the same vernier, the variance of the distribution of the error component is the same 
throughout, and 
" APBIV, 
Tab = газ 1. 2 Б 
(ДУ, + V.) (ВУ, + V.) 
With this analogy to the Umpire Bonus set-up in mind, we may now formulate the com- 
ponents of two composite scores recorded for the same group of persons in the following terms : 
(a) one (ху) which assesses a common attribute ; 
(b) one (х or x,,) which assesses a specific attribute ; 
(с) one (Xea, Xe) which refers to error of observation, or what is indistinguishable therefrom, 
i.e. uncontrolled circumstances affecting the response of the test subject. 
We then write our scoring system in terms of score deviations as 
X, = Ay. X, Ay. Xu + Xa 
X, = By. X,4- B,. Xn + Xo. 
The error and specific components have by hypothesis zero covariance, and they will be indis- 
tinguishable if we apply once only each composite test to each member of the test group of 
persons, so that we might then write 
Ao. Xa. o = Ag. х, + Xu and By. x). o= By. Xn + Xen 
for the components peculiar to each test. Otherwise, we must write 
А}. В} V; . Ж . () 
(4, + ATV sa + Vea) (BV, + BV o + Ver) 
In the absence of error, we might write the true correlation (r,,.,) in accordance with the 
implicit assumption V,a = 0 =V,» so that 
М АБУ} 
© (AFV, + AEV s1) (SV, + BEV a) 
ж.е 20, + АУ. БУ В, + BV sy + Vien Gi) 
5, А, + АУ. `В, + BVa we c 
Let us now suppose that we repeat the same test on each person, so that we may correlate the 
first composite test score of each person with his or her second. In this set-up x,, and x, are 
each common components of the two scores at the same trial (i.e. the two scores of the same 


person) ; but the error component differs from trial to trial. For test A we may therefore write 
our equations as 


ль 


Xar = Арх, + А, H ха; 
Ха = Ах, + Ашхы + Xor 
The situation so described is one in which x, and x,a correspond to the independent 


contributions of different umpires and x, X, correspond to the individual components х,. o 
and хь. , of our bonus model. On the assumption that errors of a given magnitude occur with 
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equal frequency on both occasions V, = V,a = V.a Thus we may write the product-moment 
coefficient of the test-retest as 

Lon AV t+ AS _ AW + AV u 
"C ABV, + AV + Veo p 
Similarly, we may write 


(ii) 


d BV, + BW. В, + BV a 
> BY, + ВУ. + Va V, i 


By substitution of (iii) and (iv) in (ii) we therefore obtain the so-called correction formula for 
attenuation, viz. : 


(iv) 


т» Tab 
The Taa * Tob шс Аты Ta i б m 
In this formula, ra». , is the expected value of the product-moment correlation between A and 
B test scores in the absence of errors incident to the carrying out of the test, fa, being its crude 
value. We may speak of 7,, and rp, as coefficients of reliability, since their value is unity if there 
is perfect test-retest agreement, in which case x, is constant and V, is zero. 
In the set-up under consideration, we may label the components of our test-score devia- 
tions, thus 


‘Test Score Communality Specificity Error 
X= AX, TAX HAX ea 
X, = B,X, | +B,X» +в,х„ 

RELIABILITY ERROR 


In this set-up the correlation between tests A and B assessed by the p-m index (ras) of the 
test scores Xa, хь, is comparable with the correlation of the scores of two players who receive 
multiples of the same bonus from one umpire in the model of 12.01. If we could actually isolate 
the common factor (ху) equivalent to the umpire's bonus, we could then record ray or 7; the 
test-score factor correlation corresponding to the correlation between the umpire's score and 
that of the player. Formally, this is 


AV, BV, 
m= and =. 
= A an (] V, 


"The corresponding components of variance for test A are thus : 


Source Actual Proportionate | 
Total Ve 1 | 
Communality Ay, ту | 
Specificity AV 10 Too — @ | 
Reliability AV, + Aus Taa | 

| 


Error ANV ae | 1 — Faa 
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Let us now return to our equations exhibiting the three additive components, and express 
them in standard form, i.e. 
2,=—, etc. 
ga 
Thus we may put 


Xa Ap; Xy Ас. Ха, Аса Хы 


і . F 
Oa Oa оу Oa Osa Oa Oea 
We may then write 
Aya, ‚ Ао» ‚ Aves 
а,; а,; e 
Oa Oa Oa 


The definitive equation of the A test score thus becomes 
Za = ау; + aisa + akea 
The variance of the distribution of our standard scores being unity, we may therefore write 


а +а +0 = 1; 


а= &" =n; 
ARS ДИ 
day py tne 
Whence we may write the proportionate contributions to total variance as 

Communality a= ту; 
Reliability а + Gi = тв; 
Specificity a= Taa — T}; 
Error а = 1 — т.а. 


Here а word of caution may not be amiss. It might seem more consistent with the pattern 
of the correlation matrix to denote by ^ш, Tò», etc. the entries in the left-right-downwards 
diagonal. We correctly label them in the above symbolism as 77, 75, etc. In the jargon of 
factor analysis we speak of ay = r,; as a factor loading or saturation, When there are several 
common factors contributing to a set of intercorrelations, we may number them as below : 


Za = аузу + daz. + damp... Assa + AF eas 
Bp = һзу + Dy, + 5... Б, F beter 
It follows from results obtained in 12.01 that 
Ta == Ta ty ӘС 
The total communalities w.r.t. the two tests are then 
++... and BHH... 
‘The p-m intercorrelation for tests A and B is 
ab, + а, + а... 
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18.07 THE SINGLE FACTOR PATTERN 


We have seen that a truly hierarchical pattern embodies the set of identities called vanishing 
tetrad differences. Before we explore a way of determining the factor loadings for such a pattern, 
it will be useful to recognise another set of identities involving triads, e.g. Ta», Tac and т. For 
the single factor pattern in the symbols of 18.05, 


Таъ -Tao = (Tau: Tou) (Tan Yeu) = Tau ow'eu = Tau Tio 


Гавно э 6) 


Similarly we derive 


Tab- Ta Tae + Ta. 2 = 
пш “== Ш : > B - (ii) 
From any four intercorrelations involving test A we can thus derive 3 estimates of the 
communality fau = a, and similarly 3 of bu, cy, du etc. It follows that the triad ratios defined 
by (i) and (ii) cannot significantly exceed unity and should not significantly differ inter se if 
the product in the numerator has the same common factor for all. In practice, however, we 
shall not expect perfect agreement. For the example of a good hierarchical pattern in 18.04 
(p. 785) the triads involving the A test communality are ABC, ABD, ABE, ACD, ACE, ADE. 
These yield the following numerical values of 73,: 0-75, 0-80, 0-83, 0-75, 0-81, 0:77. This 
raises the question : how can we choose a satisfactory average ? We may write the sum of the 
numerator products of the foregoing set of triads in the 5-test table as 


Satis) = Tab - Tac + Tob * Taa + Tab «Tae + Toc Taa + Рае + Тае F Tad > Tae 
From the derivation of (i) and (ii) we see that 
Satin = Tulou + Tou + Tous Tàu + Tou «Teu + Tou + au + Yous Yeu F Tau- Teu). 
^ Similarly, we may write the sum of terms corresponding to the denominators of (i) or 
i Sij = Tre + Toa + Toe + Tea + Tee Тае 
= Tou + Tou + Tow Tau + Tous Teu T Tews Vau F Teu < Yeu F Yau + Tow 

Whence we have 

ее we „(Шу 


Tou 5, 


In this expression Saun means: add up all the products оў two different cell entries in either the 
A-row or the A-column of the correlation matrix. "The denominator S,, means : add all the entries 
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on one side of the left-right-downwards diagonal, excluding those in both the A-row and the A-column. 
For the specimen set-up on p. 785 (18.04) we have : 


A HE LOO Diner, Product Total 5,4) 


A... Tab Tae Таа Tae Tarlac + Tasa + Tarlac t acad; etc. 
B. 
c. Toc 


Total S | 


The pooled value of 77, in (iii) for the numerical example of p. 785 would thus be 

72, = [(0-73)(0-61) + (973/053) + (0773)(0-44) + (0-61)(0-53) + 0(61)(0-44) + (0-53)0-44)] 
+ (0:55 + 0-50 + 0-39 + 0-43 + 0-36 + 0-29), 
+. 73, =0-79 and ra, = 0-89. 

As an alternative to this procedure, there is a hit-and-miss method of determining the 
factor loadings (faw etc.), and its rationale is instructive in connexion with analysis of data 
which do not conform to a single factor pattern. To understand it, we must take stock of 
relations which subsist between the grand total and column or row totals of the cell entries of 


the correlation matrix. A 4-test matrix for an exact single factor pattern will suffice to make 
this clear. 


A B с р 

А Yiu Tap = Fau - Tou Tac = Taw -Teu Tea = Т-ты | 

B Tay = Tau -You rhe Toe = Fou Ten Tha = Fou Taw | 

c Tae = Тац Tem | Tee = Fou -Teu | ты Tea 77 Теа. Таш | 

D | а= тты | тыа=ты.ты | faa та-та rhe Grand Total 
Total ta ty | te | 3 T | 


In the foregoing schema ta, t», etc., are column totals and T is the grand total of the inter- 
correlations in both dimensions after completing the diagonal entries. We may denote the sum 
of all the factor loadings (a, = Taw b, = Tow etc.) as 


Su = Tau + Tou + Tou + Tau 
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By inspection we see that 
ta = Tau * Sw 


T= ta + to + te + ta = au + Tou + Teu + Таш) 


— 1, — 
VT 


To find a,, b,, etc., we may thus proceed iteratively as follows : 


БОА Re EE 


Tau 


(a) guess values of a2 = r2, b3 = ту, etc., by assigning the diagonal cell numbers which 
fall into step with the hierarchical pattern ; 


(b) sum the columns and add these to get the grand total ; 
(c) divide each total by the square root of the grand total. 


If our initial guesses are good, (c) should give values а„, bu, etc., whose squares tally closely 
with the assigned diagonal entries, some being a little higher and others a little lower. Indeed, 
it may well happen that we can now reconstruct from the products (Tap = a, . bw etc.) of these 
first approximations to the factor loadings a matrix of which no cell entry differs significantly 
from the original one based on the observed data. Otherwise, we may adjust as follows. Ceteris 
paribus, an assigned a, if too high will make T too high and hence t, = a, V T also too high, as 
will be seen by reference back to the observed data after addition of the assigned a; to complete 
the column total. Accordingly, we next try out a somewhat lower value of а„ and proceed 
(mutatis mutandis) to deal with the other columns in the same way. Usually, a second guess 
will be good enough. 

Another property of the single factor correlation matrix is a useful check on the computation 
at each stage. If we denote by T, the grand total of the cell entries in the matrix of observational 
data, and by D the sum of the diagonal terms, the following relation holds good for the completed 
matrix : 

T=T,+D=s. 


Thus the sum of our assigned diagonal entries added to the sum of our observational entries 
should correspond closely to the square of the sum of the assigned factor loadings, if our guess 


is good. 
18.08 Tur Bi-FacroR PATTERN 


As we shall later see, factor analysis is like analysis of variance in more ways than one, and 
especially in so far as there is: (a) no room for doubt about its limited usefulness in certain 
situations ; (6) ample justification for suspicion of some claims put forward on its behalf. The 
recognition of a single-factor pattern is an example of what we can do without making arbitrary 
assumptions which we cannot justify by reference to the data ; and a second pattern, called the 
bi-factor, is another. 

It may happen that a set of intercorrelations which do not exhibit close conformity to the 
hierarchical principle is classifiable if we group the tests in such a way that members of the 
same group are highly correlated inter se but weakly with members of other groups. If there 
are more than 2 such groups and at least 4 members in each, we are now in a position to proceed 
with confidence to explore the consequences of the hypothesis that 
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(a) all the tests are correlated in virtue of a single factor common to all ; 
(b) members of the same group are more highly correlated in virtue of a factor common 
to and peculiar to the group. 


The reader should now find it easy to translate these postulates in terms of the Umpire 
Bonus Model. Though a satisfactory vindication of the bi-factor pattern by the procedure we 
shall now examine calls for at least 12 tests, it will suffice for illustrative purposes, if we 
formulate a schema for standard scores of 10 tests involving 3 groups after correction w.r.t. 
reliability as follows : 

Za = Gy. 34 + Gy. Za + Gy Zya 
Zy = b, -21 + b: -2 +8, Za 
Ze = C -31 + Cy. Bat €... Zee 
2,77 d,.2, + di. 2, - d, Z,a 
Be = C1. BH 6.25; He, o Bee 
ау =Й. F Sa -3a + fe By 
Zo = 81-31 Za- E ESI. 
з. =h. a, + hy. ay + h. Za 
z =j B+ 45-2, Ji. 284 
By = hy 31 + hy. By + hy xa 


For such a schema the correlation matrix is as in Table 4. 

Provided that there are at least three groups as in Table 4, in which they are (ABC), 
(DEFG), (HK), we can form at least one triad involving only intercorrelations of members 
of different groups, e.g. : 

Таа-ак edh. k à 
Tak deko - 
If each group contains at least 2 members we can test the result, since we can then extract at 
least one other equivalent triad, e.g. : 


2 " 
Тав - Тај Q1. 4p. fi 
Tes ed 


Having provisionally vindicated the possibility of extracting values of a, b, etc., with good 
agreement between the several estimates of each, we are now in a position to make a matrix 
exhibiting what the approximate values of the intercorrelations would be, if there were no group 
factors, i.e. if they arose entirely from the common factor. "The first, fourth and last row would 
then read in conformity with the product rule for the single factor pattern : 


aj. 


2 : 
si a,b, 4,6 ad, aêr af, agı ah, 4j akı 


Е аа, bd, id, di dye, af, ад а СТД dik 


akı b, ef dk, eh fih gh hk, Ah ki 


On subtracting cell entries of this matrix from the corresponding one of Table 1 we now have 
a matrix of residuals shown in Table 5. 
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"Thus the entries for the between-group correlations in our matrix of residuals offer us an 
additional check on our procedure, viz. none of these residuals should differ significantly from 
zero. If the result confirms our supposition, we may proceed to assign the values of the group 
factors а,, ез, ky, etc., by the method of triad summation implicit in (iii) of 18.07. With appro- 
priate modification the same procedure is adaptable to the extraction of pooled values of the 
common factor, і.е. to extract a principal factor loading a, in group I we form : (a) the numerator 
by summing all products in the A row between cell entries of the original matrix after excluding 
those which belong to the same group as А itself; (b) the denominator by adding from one 
side of the diagonal involving all intercorrelations two members of different groups other than 
the A-group. 

An exacting vindication of the bi-factor set-up will demand that the group residuals are 
consistent with a single factor patter, i.e. within a group tetrad differences vanish and the triad 
ratios are consistent. The extraction of the residual matrix by the procedure outlined above 
itself presupposes that there are at least three group factors, and we have no check on the first 
step unless each group contains at least 2 members. To validate the last stage we require at 
least 4 members in each group, since three would provide only a single estimate of any one factor 
loading. 


18.09 HIGHER Factor PATTERNS 


In the foregoing treatment of the bi-factor pattern we postulate a single common factor and 
3 group factors. We then have three groups of tests each with two common factors. We shall 
now ask : is there any procedure by which we could validate our assumptions, if the data suggest 
the existence of only 2 group factors ? If so, we have 2 groups of tests, with 2 and only 2 factors 
common to members of the same group. This feature of the bi-factor set-up prompts us to ask : 
is there any criterion analogous to the tetrad principle to define a set of intercorrelations involving 
the same two sources of variation and no other ? 

An answer to this question is obtainable by recourse to elementary algebra as for the 
derivation of the tetrad equations in 18.05 ; but the procedure is laborious. The advantage of 
side-stepping the labour entailed by use of grid algebra in connexion with this problem and 
a fortiori in connexion with the exploration of more complex factor patterns explains the pro- 
minent role which matrix algebra plays in expositions of factor analysis, and hence also the 
prevalent jargon of factor-space and other geometrical mataphors suggested by matrix operations ; 
but the truth is that the logical assumptions underlying factor analysis are explicable without 
reliance upon it and to all except the mathematically proficient easier to grasp in the language 
of the more elementary mathematics employed in foregoing sections of this chapter. Factor 
analysis presupposes a system of score components expressible as simultaneous linear equations. 
of the type we have met with in connexion with the Umpire Bonus Model. If there are only 
2 or 3 relevant variables, recourse to determinants has little value as a labour saving device. 
There has therefore been no good reason for making the assumptions implicit in factor analysis 
stepping the labour entailed by use of grid algebra in connexion with this problem and 
less accessible to readers not at home with determinants and/or matrices by invoking their aid 
in what has gone before. At this stage, we do so merely because the algebraic treatment of the 
problem raised above is otherwise very laborious. There is no indispensable tie-up between 
the logic of factor analysis and the matrix algebra which most expositions of the procedure invoke 
at an introductory stage as a prerequisite to understanding it. 

Before proceeding further let us recall the structure of a tetrad equation, e.g. 


Таъ -Tia — Tak Tsa = 0. 


ELEMENTS OF ANALYSIS OF COVARIANCE AND OF FACTOR ANALYSIS 799 


In this expression r,; and r, , are cell entries of the same (A-) row, fax and r;, are cell entries 
of the same (K-) column, r,; and r;, occur in the same (B-) column, while r;, and ry occur 
in the same (Q-) row. Thus the 4 relevant entities occur as cell entries at the apices of a rect- 
angular segment of the matrix and as such constitute a minor of the first order, viz. : 


Ter Tox 
= rab Tis — Tak Toor 


Tea Tea 

We might therefore express the tetrad rule derived in 18.04 by saying that one common 
factor and only one suffices to specify a matrix of intercorrelations if every determinant minor 
of the first order vanishes. 

This suggests a more general rule due to Thurstone. For our purpose it will suffice to 
demonstrate it for a group of tests each pair of which involves 2 common factors and two only. 
The rule then states that all 2nd order minors of the correlation matrix must vanish. Below 
we set out such a minor: (а) in terms of the cell entries; (b) in terms of the loading factors 
prescribed in 18.06 and 18.07. 


Tro а T bies +b, Ы + bak, Бут + bam, 
To Toa Ts |= А = | е +g, Biky tgk gom + Bay 
| Ne á h Tm Ле tjes ik tjk fm + jem 


We may reduce the determinant on the right as follows : 


^ k m 
b+ B b+ bay b, + um 


А, _ е, LA m, 
aa | tee ntm А+ Lo 
: „т, 
Athy ohti ht р 
в _т hom РЫ 
ad 2-2) ан 
м 


(2-2) л 7-2) hie 


bs b bob 


1 
zz 
515 
І 
313 
us 
p 
e 
l 
ЫЫ 
Su 


& AB ont en 

h oh tie 
The determinant in the last expression has two identical rows, whence its numerical value is 
zero and \ 

A; = 0. 

"This completes the proof that the 2nd order minors vanish, if all the intercorrelations аге referable 
to the same 2 common factors. The converse assertion is demonstrable. As an exercise, the 
student may paint in the values of r;,, etc., for a 3-factor set-up, e.g. 


Tre = bie, + bees + Без. 
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We then find that A, vanishes only if one of the factors is algebraically redundant. In short, 
the full statement of Thurstone’s rule illustrates one of the uses of matrix algebra in the theory 
of equations, i.e. to prescribe the redundancy or otherwise of one or more variables. Geometrical 
terms employed in the theory of equations are suggestive to the mathematician who is already 
at home with them ; but this is not essential to an appreciation of what a particular factor pattern 
postulates. We could, of course, express Thurstone’s rule for the 2-factor pattern in the form 
it takes when we expand the 2nd order determinant, viz. : 


Took — TomT sr) — Tox (Toe%im — Tom se) + Tom(Toe%se зе) = 0. 


The student who wishes to check this by lower school certificate algebra may do so. The attempt 
will at least dispose of any lingering doubts concerning the advantages of a little familiarity 
with the use of determinants. It will also be a wholesome demonstration of the irrelevance of 
portentous excursions into matrix algebra as a preliminary to understanding the logical assump- 
tions which factor analysis prescribes. 

The rule we have last examined raises the question, how many tests in a group suffice to 
identify a 2-factor pattern with due regard to the fact that our observational data do not furnish 
cell entries for the diagonal of the correlation matrix? For a single factor pattern we need 
4 tests to provide a complete first order minor. This is evident, if we set out as below a 3-test 
matrix on the left and a 4-test matrix on the right : 


— fe Pul [— fe Ta Tes 
ж» — ты Pas — ^ лы Оты 
fa f = Te Te = тш 

та ты та — 


Evidently, we cannot get a 2nd order minor from the 4-test matrix. Nor can we do so with 
5 tests. We need at least 6, as below. 


2 Tob Tac Taa Tae Tor 
Tab = Tre Toa Tre Toy 
Tae Tre x Tea Tee Tet 
Taa Toa Tea E Tac Tat 
Tae Toe Tee Tae = Teg 
Taf „у Tet Tat Tut cai 


Theoretically, then, we can check up on the requirements of a bi-factor pattern involving 
one common and 2 group factors if each of the two groups contains at least 6 members or twelve 
in all. By applying Thurstone’s rule to each group and to the entire matrix we can establish 
the conclusions : (a) 2 factors suffice to explain correlations within the group since second 
order minors vanish ; (5) one factor suffices to explain correlations between groups since inter- 
group tetrads vanish, e.g. in the schema of 18.04, 7,3. т, = Tay - Tea 

It remains to ask: can we assign to the common factor values from which we 
can reconstruct by subtraction (as in 18.08) a matrix of residuals having values consonant with 
the requirements that: (a) inter-group residuals are zero; (b) intra-group residuals are hier- 
archical ? To clarify the situation the student may set out in full the schema of inter-group 
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correlations for the single common factor components of the matrix for a battery of 12 tests, 
A-F being one group and G-M the other ; but it will suffice for illustrative purposes if we take 
3 of one group and 3 of the other as below: 


G H у "Total 
Factor [a h | А 5 
Aj а [ET | Ta abu | ты = аў ta = аз, 
B b w-bhn | ron = bil nm nm 
с a Teo = ER | Ten = Għ, fg = сй te = с, 
Total Sa ty = Eis | in = hsa ty = jise Т = Saso 


Evidently the hierarchical principle obtains for all inter-group correlations, but the reader 
who is familiar with the theory of equations will find that such a schema yields too few inde- 
pendent equations to admit of a unique solution for the factor loadings. Since one exception 
suffices to dismiss the possibility, it is instructive to exhibit two complete solutions as below : 


"Total 
Factor (0:3) (04) 05 | (12) 
(0:2) 0-06 0-08 0-10 0-24 
(0-5) 0-15 0-20 0-25 0-60 
(0-1) 0-03 0-04 0-05 0-12 
— 
"Total (0-8) 0-24 0-32 0-40 0-96 
"Total 
Factor (0-24) (0-32) (0-40) (0-96) 
(0-250) 0-06 0-08 0-10 0-24 
(0-625) 0-15 0-20 |ы 0-60 
(0-125) 0-03 0-04 0-05 0-12 
"Total (1:0) 0-24 0-32 0-40 0-96 | 


"The restrictive relations in the evaluation are all included in the system of equations exhibited 
in the row and column totals of the schema 


hb. o. t; 
="; 4-3; 
CiU Cara 
PES t te 
pay eL 
pisa у: 
Uo 9 7 
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By starting with an arbitrary value of sa, the reader may easily check that any set of values con- 
sistent with the above works. For example, s, = 3 implies that s, = 0-32 to give T = 0:96. 
We then have 
-24 Я 
£ ч 3 008; a, = 0:75; fas = (0-08)(0-75) = 0-06, etc. 

Now any set of common factor loadings such as the above would lead to the same residual matrix 
from which to determine our group factor loadings. "The situation is therefore this: we can 
recognise what the factor pattern is; but we cannot assign unique values to the factor loadings. 

This lack of uniqueness is the pivot of a controversy which involves two issues. On the 
analysis, if the factor loadings they prescribe are arbitrary. On the other hand, it may be in- 
structive to recognise the existence of a factor pattern in the absence of a numerical specification 
of the loadings; and we have seen that this may be possible to accomplish when no unique 
numerical solution is realisable. If so, it is importarit-to be clear about what we mean by recog- 
nising the pattern. 

Against the background of the Umpire Bonus Model, the reader who cares to pursue the 
topic will find the following hints helpful. Of two essentially different procedures subsumed by 
the term multiple factor analysis, that of Thurstone admits the possibility that: (a) a score 
referable to a particular test may contain a specific factor component ; (b) the number of non- 
specific factors may be as great as the number of different pairs of tests in the battery. In the 
idiom of the Umpire Bonus Model this means that each player's total score contains some multiple 
—not excluding zero as a possible multiplier—of his individual score together with some multiple 
— not excluding zero as a possible multiplier—of each of different umpire contributions equal in 
number to the number of pairs of players. The initial formulation definitive of score value 
components thus leads to a system of fewer equations than variables. Тһе solution sought by 
an iterative procedure is the most economical in the sense that it seeks to interpret consistently 
any inter-test correlation in terms of the least number of score components. 

The assumptions implicit in Hotelling’s procedure are on all fours with the rules of the 
model 3-wheel game prescribed at the end of 12.07. There the player is passive, each player's 
score being made up of contributions from the same number of umpires not exceeding the number 
of different pairs of players in the initial formulation of the Hotelling set-up. The number of 
basic equations definitive of score components cannot therefore exceed the number of variables, a 
circumstance which confers on the game an aspect of greater algebraic propriety than that of 
Thurstone. Again, however, we must invoke a quite arbitrary axiom of economy in the search 
for a saitsfactory selection of one among many consistent sets of factor loadings ; and the pre- 
scribed procedure will lead, as pointed out by Godfrey Thomson, to different factor loadings if 
we add a new test—and hence the possibility of n new factors to an n-fold test battery. 

Either method involves an issue which is outside the scope of mathematics as such. Thur- 
stone himself faces it frankly when he appeals to William of Occam’s principle: entia non 
multiplicandur praeter necessitatem. According to his view the most economical factor loadings 
are the best because economy of hypothesis is a canon of scientific method. This plea is open to 
criticism at more than one level. The use of the term economy in scientific enquiry is not wholly 
unequivocal ; and what G. P. Meredith calls the epistemic status of the canon is itself debatable. 
As the writer sees it, a methodical scientific worker will rightly choose to investigate first the 
simpler of two hypotheses to forestall unnecessary waste of effort, if it stands the test of experience 
equally well. So interpreted the Occam principle embodies a wise code of procedure in the 
process of discovery ; but embodies no rational prescription for deciding whether one or the other 
hypothesis is true or false without appeal to the higher tribunal of the experimentum crucis. 
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All such procedures referred to as factor analysis presume a strictly additive relation between 
the score components and zero covariance between any two of them. In the absence of con- 
firmatory evidence, this assumption, which is also inherent in the construction of the balance 
sheet of the analysis of variance, is highly arbitrary and sometimes grossly inappropriate. In 
Chapter 13, we have seen how the replication criterion may give us the opportunity of confirming 
the additive postulate when the end in view is a balance sheet of variance, and we have seen 
reason to believe that the same principle is both a necessary and sufficient condition of the 
validity of Thurstone’s rule and the tetrad criterion as a special case of it. Just as it is all too 
common practice to overlook the importance of the replication criterion, it is all too common 
to execute elaborate computations to extract factor loadings when there is : (а) no other clear-cut 
factor pattern to validate the initial assumption of the additivity of the score components and 
the twin postulate of zero covariance ; (b) no possibility of arriving at a solution preferable to 
others equally consistent with the data, 
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CHAPTER 19 


SAMPLING IN A FINITE UNIVERSE AND 
MANIFOLD CLASSIFICATION 


19.01 THe HYPERGEOMETRIC DISTRIBUTION 


WE have already (Chapter 2, Vol. I) obtained the exact expression for sampling without replace- 
ment in the domain of binary taxonomic scoring, viz. a distribution defined by successive terms 
of the binomial in factorial powers : 


GIO (ng +p)” 


nn n" 


If the sampling fraction (F) defined by the ratio nF = 1з small and n is very great, we have 
seen (Chapter 3, Vol. I) that we may regard the distribution as approximately normal; but 
we have not as yet explored the possibility of finding a satisfactory fitting curve when 7 is great 
if F itself is not a small fraction. We shall now do so by recourse to the method of moments. 
For reasons which we have seen in 14.04, it will be convenient to derive first a general expression 
for the factorial moments, defined as 


zer 


ма = am E s о-о 


х e — zai ! 
In this expression 
rl=r®%(r—R)!; s = ss — gam; 


am 1 
xl (œk! 
E rgo ter (r = k)! ERAF) А 
+ Po no Ze- Al e—a) =A . . (i) 


If we write (r — А) = а and (x — k) =b: 


z=r (r -- А)! 5-6 а! 


heme 0 = 2 а E 


When 5 < 0, the reciprocal of b! is zero, whence 


S (r — k)! (s kefe- bi (s ky (a-b) 
Ho (x — k) I(r — x)! Hem 
=@+/—®® 
= (n — k)yr-». 
Whence by substitution in (ii) 
1) sg E kyr-^ 


Hay = LE NDS 
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In this expression 
пе = n®(n = Rr, 
rogo 4 
seu) = MARO + Я < 2 s : . (v) 
From (iv) we at once obtain the zero moments by the substitutions 
Ш = ща + Ша» 
Bs = ша + Span + ay 


Ba = Ba) + бщз +T + ho 
Whence we derive 


rs 
iT : 2 : : : о . С 2 (00). 
Pa ets іп Er — 7 —3) a 
EE AG =), wi) 
qM 300000 ys А 
Hs — "wm + PT a > К E ^ sai) 
PMSA) 6030608) 70006002 rs ez 
F = 90 n» m9 Ta (viii) 
We can now obtain the mean moments in the usual way : 
төз ys ghi 
unir Шуша 
mI MEALS E WS 
GENDER (nrs— nr — ns + n + n? — n — nrs + rs) 
TS 
= яа 1) (п — r)(n — s) 
(п — т) 
— atn —1) 
If we write s = np, f = лд and r=nF 
(1 — Fyrpe 
C) 
n, 
Whence for large values of n 
m, œ(1 — Е)трд . . . . D « (ix) 


Tt will simplify the task of evaluating the third and fourth mean moments if we express 
them in terms of factorial moments as below : 
Ms = pa — Spa + 280 
5 та = ща — Sip (Aa) — 1) + olun — 1) (Hay — 1). - E . 0 
m, = pa — Араша + Supt — Зи, 
zm, = pay — 2ща(2ща — 3) + ii (6t — 12 +7) + poluo — D — 1) (xi) 
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Whence we have 


ras — 370205020 — n) | rs(2rs — n) (rs — m) 
Я 


id n? nn : n? 
rpalg — p) (n — 7) (n — 2r) ü 
eo) : . б 5 . . (xii) 
On the assumption that the universe is large, so that (n — 2) œ n, we therefore have 
mcer —p)ü-—F)(-2F). . . . . (бш) 


In the same way we obtain 
m, = rpg(n —r)[n(n 4- 1) — 6r(n — 7) --3pg(n*(r —2) — nr? +-6r(n—r)}]+(n—1)® (xiv) 
у. my 1pq(1 — Рр — 6F(1 — F) (1 — 3р4) J-3p(r—2—nF?] .  . . (ху) 
All the expressions for the moments cited above reduce to those of the replacement distribution, 
when F = 0 as must be true of a finite r-fold sample from an infinite (n = 20) universe. The 
appearance of the factor (1 — 2F) in (xiii) shows that the third moment vanishes when the 
sampling fraction is }. In fact, all odd moments then vanish, as we can see from the following 
considerations. Let us consider the frequencies (y, and у») referable to score values x, and x, 
equidistant from the mean on either side of it, so that we put x, = (M — a) and x, = ( M+ a). 
If F = }, we have (n — s) =f = (2r — s), and 
y 09007 — s- _ xl (r — x) 
љ ara) "9007 — a 
_ #И-%@ — Мо (М +0) = МЕ а) 
=M- alr — М + a) +902 — se M79 © 
On substituting in accordance with the formula c . (c — х)! = cl, this reduces to 


yı (M+a)l(s—M—a)!(r—s+M+a)l(r—M—a)! 
Ye (М а): М +a)\(r7—s +M—a)!(r M--ayr 
Since M = rp and s = np, the condition F = } implies that M = 3s, whence 


ж os +a)! ($s — a)! (r — + + a)! (r — às — a)! 
ya ‘(4s — a) (s + a)! (т — 3s — a)! (r — 3s + a)" 
ns 
Уг 
Thus the frequencies of any two score values equidistant from the mean аге identical when 
F =} and the 7-fold sample distribution is symmetrical whether р is equal to g, greater than 
q or less than q. 
Thus f, vanishes if F = 4, just as it also vanishes if p = q, ie. s = 3m. Subject to the 
same condition, (ix) and (xv) reduce to 


m, = pos 
ии Xt, HM, 
ъв МОИ ИЙИШИ GS 


трд 
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"This has the same form as the second Pearson coefficient defined by (xx) in 15.04 for the symmet- 
rical B(j, k) variate of restricted range (Type П). This we have seen to be 
6 
Bs =3— JFS 

This is equivalent to the above when 

.— 6palr — 1) — 3000 + 1) 

J бра +2 2 
To satisfy the requirements of Type II, it is also necessary to show that 

2 


map "d mq ply 
2 
Был лден 
Sm = +. 
In our expression p = 7р and 2m, = грд when F = $, so that the above also implies the 
relation 


MID 
ipee t 


When р = } = ф the distribution is again symmetrical regardless of the size of the sampling 

fraction, so that 

6F(1— F) +2 

7(1—F) ' 

This again is consistent with one of the requirements of the Type II distribution if we write 
._ X1- F)(r— SF) — 3 
= iat ТЕГ ЖАШ 

More generally, when neither p nor F is equal to 3, the form of the B coefficient may conform 


with Type I requirements. The determination of the constants is laborious, and the student 
who wishes to pursue the topic may consult Pearson’s tables of the Incomplete Beta Function. 


B,—0 and „=3— 


19.00 Moments оғ a Score-Sum DISTRIBUTION 


The results derived in 19.01 are obtainable from more general expressions for the moments 
of a score-sum distribution in the domain of representative scoring without replacement. To 
establish them, a digression is necessary. It is the peculiarity of binary taxonomic scoring that 
the algebraic form of the unit sample distribution is inherent in the statement of the problem. 
Representative scoring—except in the limiting case of a 2-class system—raises a new problem, 
In the foregoing section, we have determined the moments of the non-replacement distribution 
of samples from a binary universe to obtain an approximate expression for the distribution of 
the 7-fold sample. In what follows we may remind ourselves that a continuous distribution can 
give a satisfactory description of a universe only if the number of score classes is very large, and 
hence that we may usually disregard the consequences of non-replacement. We therefore 
assume that the unit sample distribution is discrete. In practice, we may likewise assume the 
unlikelihood that our manifold universe of scores closely conforms to any known discrete sampling 
distribution such as the rectangular or the distribution defined by successive terms of a binomial 
or of a Vandemonde expansion. It will suffice to postulate that we have empirical sources of 
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information from which to determine the moments of the unit sample distribution, and on that 
understanding we shall derive an expression for the moments of the r-fold distribution without 
recourse to other data. 

Subject to the replacement condition or to the postulate that the size of the universe and/or 
sampling fraction permits us to disregard it, we have obtained expressions of this sort in 14.05 
by the method of iteration. We shall now show how it is possible to derive them by a different 
procedure which is adaptable to situations in which : (a) there is no replacement ; (b) extraction 
of the sample materially changes the composition of the parent universe, 

We customarily define the representative score of a sample by the mean of the constituent 
individual scores, i.e. by the quotient of their sum and the sample size. The latter being constant 
for a sample of given size is immaterial to a specification of the distribution, since all the para- 
meters of the distribution of the mean are obtainable from those of the sum (S,) of the r-fold 
sample by a scalar change involving r alone. We can regard the r-fold sample as r successively 
extracted unit samples of score x,, so that 


S,—x-bxedx 20. . %= > X 


By definition the Ath zero moment of the score-sum is the expected value of S; and we may 
write this as 

(Sp) = Eloy + xs +... х). 
An examination of the moments of the 3-fold sample distribution brings into focus what we 
need to know in order to evaluate an expression such as the above. Thus we have 


Ha(‘S3) = E(x, + xa + x3)? = E(xj) + Е(х$) + Е(х%) + 2E(o, . х) + 2E(xy . хә) + 2E (xe . х3). 


Now the subscripts we attach to x in this expression refer to the order in which we extract the 
unit samples, regardless of the numerical value any individual unit score x, or x, may have. 
This expression therefore contains terms of two sorts: (a) squares of unit scores ; (6) products 
of unit scores whose numerical values may be the same or different. If we replace each item 
to which we attach a score before drawing another it is evident that: (i) the numerical value 
of the square unit score does not depend on the value of the subscript w or v ; (ii) the numerical 
value of the product of different unit scores is likewise independent of the particular values 
assigned to и and to v. Whence we may write the last expression in the form 


Ha(Ss) = 3E (x) + GE(xu . х). 
Similarly we may write 
Ha(Ss) = Е(х1) + E(x?) + E(x) + ЗЕ(хї. x2) 
+ ЗЕ(а1. хз) + SE ху) + ЗЕ(хї. x) 
+ ЗЕ(хў. ху) + ЗЕ(х$. х„) + GE(x, . x2. ху), 
w+ pa(Ss) = 3E(x2) + 1BE(xz . х.) + GE (xy. х„. xu). 


In these expressions E(x?) and E(x3) are resepectivly the expected values of the square and the 
cube of the unit sample score, i.e. of the second and third moments of the unit sample distri- 
bution ; and we may write these as из and из respectively. We may speak of a k-fold co-moment 
as the expected value of the product of the unit scores of a k-fold sub-sample, and write 


E(x,.x,) = ра.15 (хи. х.) = pa = Ё(х„.х,); 
E(x, . 3, . Xu) = ша. ete. 
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In this symbolism, and subject to the replacement condition unless we can subsequently show 


its irrelevance, 
H2(S3) T Зи» ТЕ би. 15 
(53) = Зиз + 1805.1 + би.1.2 
When replacement does occur we may write 
E(x, « x) = E(xi)E(x) 5 
Ele x.) = En) EG) E(x), 
7. pyk = Bas Pe апі priy = Ba Bis Mee 


Ha(Ss) = Зиз + биї; 
Ha(Ss) = Зи + 18. а + би]. 
In the same symbolism, аз the reader may check by expanding (x, + xe + ха), 
(53) = Зра + 24... pa + 1805 + 36би„. på- 


"These considerations suggest the possibility of obtaining general expressions for the zero moments 
of the r-fold score-sum of a replacement distribution if we can enumerate terms involving the 
same set of exponents in the expansion of the expression (x, + xs + x;... x»). It will clarify 
the issue if we re-examine the derivation of the multinomial theorem by recourse to the 
chessboard device. 


Hence we may write 


19.03 CHESSBOARD DERIVATION OF THE MULTINOMIAL THEOREM 


The chessboard device is at once a replica of the algorithm of multiplication and a means of 
exhibiting all possible permutations consistent with repetition. Our use of it to derive the 
binomial sample distribution in Chapter 1 of Vol. I is a particular case of its successive application 
to exhibit the build up of the multinomial, as below 


aa ab ac ba bb bc ca cb сс 
а ааа aab aac aba abb abc aca ас асс 
5 baa bab bac bba bbb bbc bca bcb bcc 


€ caa cab cac cba ebb cbe cca ccb cec 
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If we take out all terms in the above with identical factors regardless of order we may classify 
them as follows 
ааа = d; bbb=b; ссс= 

aab + aba + baa = 3a*b 

aac + aca + caa = 3a*c 

bba + bab + abb = ЗЬ?а 

bbc + bcb + chb = 3b?c 

cca + cac + асс = Зс?а 

ccb + che + bec = Зс?Ь 

abc + ach + bac + bca + cab + cha = Cabec. 


When, as is customary, we collect our terms in this way, the appropriate numerical coefficient 
of each one is implicit in the law of generation inherent in successive application of the chess- 
board lay-out. We may state it thus. The exponent of each basic term (a, b, c, etc.) is the number 
of times the latter appears as a factor in the product. In the expansion of (a +b J- c...)" 
each product will have z factors in this sense ; and the number of identical factors may be 
1, 2, 3, . . . m if m is the number of basic terms. If и, v, w, etc., signify the exponents of a, b, c, 
etc., they therefore respectively represent how many times a, b, c appear as factors in the product, 
and their sum is n. The numerical coefficient of each product with the same build-up regardless 
of order is simply the number of linear permutations consistent with its build-up ; and the 
number of different linear arrangements consistent with the build-up of a term of the form 
a" D*c" is the number of ways in which we can set out in a row л cards classifiable as three classes 
respectively composed of u, v, and w members. This if given by the familiar formula 


n! 


n c 
Pu. v.e оге 


(i) 
Thus we speak of "Р„. ». „ so defined as the coefficient of the general term of the multinomial 
of nth degree. As we have already seen in Chapter 1 of Vol. I, the sum of all the numerical 
coefficients so defined is m”, as is evident from the identity 


u-nr-n—u n! 
m" —(1--1--1...m times)! = > (ii) 

u=0 v-0 
If а= = c, etc., in the multinomial (a + b+ c...)", it will be evidently convenient 
to carry our classification a step further by collecting products of the same order, i.e. with identical 
exponents regardless of the component (and then numerically equivalent) basic terms. For 
instance we might write out the expansion of (a + b + с)? in accordance with the following 

Schema : 


EMT 


a? +b? 4- c? = 3h; 
За?Ь + 3a% + ЗЬ?а + 3b*c + Зс?а + 3c% = 18h*i; 
Gabe = 6hij. 
Similarly, we should write 
(a + b + cy = 3h? + 6hi; 
(a +b + c +d) = AM + 48h% + 36h*i* + 144h7ij + 24hijk. 


Necessarily, the rule exhibited in (ii) holds good since we have merely collected terms with the 
common property that they contain the same assemblage of exponents. Thus the sum of the 


SAMPLING IN A FINITE UNIVERSE AND MANIFOLD CLASSIFICATION 811 


coefficients of (a + b + с + d)* = 256 = 44, and that of (a + b + с)? = 9 = 3%. The general 
pattern for an expansion in terms of the same order defined as above is then 


(a ++ b 4- c... m terms)! = КЁ” + Kin h'i + Kin 80" 802 + Kop au] Эў, ete. 
We may write the general term of this expansion in the form 
Уа IT s E : x . (iii) 


In 19.02 we have already seen how occasion may arise when we can take advantage in 
statistical theory by making use of the number of products of the same order, i.e. the numerical 
value of K,.,., in (iii). When we condense our classification of terms in this way, we collect 
together a set of x products each of which carries the numerical coefficient "Py. . . +; 80 
that G, = x."P,.».- - . - Our problem is now to define x in numerical terms. 

To do so we note that any such product as A" . ¿° . j^ . . . contains e different basic terms 
and e mot necessarily different letters as exponents attached thereto. For instance the product 
of order (2, 2) in the expansion of (a + b + c)! contains 2 different basic terms (a, b; a, c; b, с) 
and two identical exponents (2, 2) which specify its order. Since we group all terms with the 
same e different basic terms regardless of linear arrangement and with the same e-fold set of 
exponents, the factor x defined as above has two components : 


(a) the number of selections of e different letters from a collection of m, i.e. "C, = ть); 


(b) the number of ways in which we can assign the e letters р, ф 7 . . . each to one ofe 
different basic terms. 


We have not explicitly examined (b) in our previous treatment of choice. In this context we may 
visualise the issue if we regard each basic term in the product as one of e boxes labelled Л, i, j, 
etc., for purposes of identification. To these boxes we have to allocate the e letters p, q, 7, etc., 
inevery possible way. If p, q, rare all different, i.e. if each letter occurs only once, as ina product 
of the form ht i? jk? in an expansion of order n = 10, there are e! different ways of doing this, 
since we may assign e different letters to the first box, and having done so (e — 1) to the second, 
etc. If two of our letters are the same, e.g. р.р. 7, there will be only one allocation ppr corre- 
sponding to pgr and gpr, one allocation prp corresponding ќо prg and qrp and one allocation rpp 
corresponding to rpq and rgp. We may generalise the consequences of this consideration as 
follows. Of our e letters, we suppose that one occurs s, times, one occurs s times and so forth. 
Corresponding to each letter which occurs s; times there would be зу! different allocations, 
if we substituted s different letters. Hence the number of different allocations of the e-fold 
set is 
е! 
ре 


If p, q, т are all different s, = 1 = s, = sy, etc., and the above reduces to el. To each of the 
Me Ways of selecting our basic terms the above expression defines in how many ways we can 
allocate the same set of experiments. Hence we derive 


el 
х= Mmo: ү 
te Sisal. - 

me el 


Cw sss... 


m^ 
а= —— iv 
Sisters 6) 
13* 
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Whence we derive 


m^ n! 
SOR SUITE OE IIT ) 
In this symbolism 
mo 6! 
К,аз = Ka.1.3 = Куу. ete, = Til amr 
mo 5! 
Ke... = 2.1.8 = “41.2.2 “Ort! * Qari 
mno 11! 
К,а = 4.34 = Ky а.а = . 21314” 
mo» 6! 
Kram a 


To clarify the meaning of (v) let us consider the expansion of (a + b + с) We may expand 
this in terms of the same order as follows : 


(а +b +c)! = Kh + Ky, hi + Kahi? + К, ү. hij + Ky ү ү, 
In this expansion m = 3 and n = 4, the values of e corresponding to the numerical coefficients 


being successively 1, 2, 2, З and 4, In two products (/*;* and л) the same exponent (2 and 1 
respectively) occurs twice. Otherwise no exponent occurs more than once. Thus we have 


30) 4l 
CSI! аш. О | 

3 4! 

Ka im: ao 2% 
30) 41 

Каз = ор. app = 18 
3 4! 

K1 = т б үп C79 
ga 4! 

Ka и mnm 
Total . . 8 


The total 81 checks, being 3t == m”. More fully, we have 
а + B+ ct = З, 
4a*b + 4a%c + Ab*a + Ab*c + 4c%a + 4c% = 24h, 
6a?b? + Ga?c? + 6b?c? = 18/°1°, 
12a*bc +- 12b*ac+- 12c*ab = 36h*ij. 
From the foregoing, we may write down the general expressions for the expansion of orders 
и = 2, 3, 4 as follows: 
(a+b+c.. .) = тор? + my. : E 5 - ` . (vi) 
(a+b+e. . ) = тһ + 3mDhi + meh . 5 f E . (vii) 
(atb+te.. ) = moni + Amos; + 3moR*? + бту + mYhijk . (viii) 
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In these expressions 


Keo = Ks.0.0 = Ki. 0.0.0 = т . . . . Алыш) 
K,—m?; Kj,!—m9; Ky,,,—m . . . (x) 
K,Q—3m9 = Kaa; Kai. = 6m. E . . (xi) 
Ку. = 4тә . . ` a - E 5 3 . (xii) 


We may now derive expressions for the zero moments of the generalised distribution of 
the score-sum by the method outlined in 19.02, where we obtained the results 
ња) = Зра + бий, 
Ha(Ss) = Зра + 18а + бил, 
(5) = Зи + pajis + 1818 + 36и]. 
"These expressions refer to the 3-fold sample. More generally, for the r-fold sample, the 
numerical coefficients in the expression, for the Ath moment are obtainable by expanding 


(x, +x, + хз... х,)", so that r replaces m (the number of basic terms) in (vi)- (viii) ; and 
we derive 


PS?) coe а ey ae Ca) 
WaS) = r.pa + 30а. Rr o l e (xiv) 
њ(8,) = та + Arpa -pa + 3700) + Grp. prt. . - (у) 


We can obtain the above by recourse to the method of iteration employed to derive expressions 
for the mean moments in 14.05; and we can derive the latter from them, if we recall that the 
expected score-sum of the 7-fold sample is 7 times the expected score of the unit sample, i.e. 
that 

ш(5,) = л. 
By the now familiar relation between mean moments and zero moments 


m,(S,) = uS») — a(S AlS) + 62(5,)и(5,) — 3uiS7) 
= щ(5,) — Arpa - p (S7) + 672. n (S7) — 3r'pi 
= тщ — Arpa « pa + Srp — Gr(r — 2), . нї + 3r(r — 2) 
=r m + Brink, 


‘The result agrees with the result obtained in 14.05; but the method would be laborious for 
higher moments. In deriving (xiii)-(xv) in this way, our object as stated in 19.02 is to explore 
a method which we shall now adapt in order to get similar expressions for the non-replacement 
distribution. To keep our aim in view let us again recall the general expression for the second 
zero moment of the 3-fold sample, viz. : 


(5) = Ex) + E(3) + E(s3) + 2E (se, . х„) + QE (oxy « 25) + 2E(xs . 23). 


If there is replacement we assume that E(xj) = из (the 2nd zero moment of the unit sample) 
regardless of the value of и which denotes the order of choice, and E(x,. х.) = p4.1 the co- 
moment of order (1, 1) has one and the same numerical value for the score product of any pair 
of unit scores which need not necessarily have different numerical values. We may then write 
as a particular case of (xiii) 


Ha(Ss) = Зи» + би. = Зиг + бил. 
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In 11.04 we have already seen that we can write иу. = pj, if and only if the replacement con- 
dition holds good ; but our examination of the non-replacement model in 2.07 has also shown 
us that previous extraction of an a-fold sample affects neither the mean nor the variance of the 
b-fold sample taken from the binary universe without replacement. Hence we have some reason 
to hope that order of choice will affect neither the moments of the unit sub-sample nor those 
of the co-moments in the domain of representative scoring without replacement. If so, we can 
obtain expressions like those of (xiii)-(xv) in the form 


ра[80] = npa +a + * . . . . : . - (xvi) 
PalSin] = тиз + 3r? ps, + rasa E . E . E ‚ (xvii) 
Isl Sc] = ты + 4r 905, + Заз + Greg tM aoa o (xviii) 


"The task stated in the opening paragraphs of 19.02 is thus to show that 


(a) order of choice does not affect the value of the moments of the unit sub-samples or 
that of the co-moments ; 
(b) the co-moments are expressible in terms of the moments of the unit sample. 


19.04 SAMPLING WirHOoUT REPLACEMENT IN THE FINITE UNIVERSE 
OF REPRESENTATIVE SCORING 


Whether we sample with or without replacement, we must regard our universe as an assemblage 
of like or different items identifiable as members of a class in virtue of the fact that we attach 
to each of them one and the same score value; but if we replace each item before extracting 
another, it is immaterial whether we can also distinguish one member from another member 
of one and the same class. Contrariwise, it is essential that we should be able to do so, when 
our aim is to clarify the consequences of sampling without replacement. With that end in 
view, let us recall the definition of the score-sum in 19.02, where we write that of the 3-fold 
Score sum as 
Sq = % + Xa + х3. 


In doing so, we label the unit scores (ху, x2, хз) by a subscript referable to the order in which 
we successively extract them. If we extract them simultaneously, we may visualise xy, xs, xy 
as score values of the first, second and third cards when we lay them face uppermost in a line. 
To say this is to say that the pack no longer contains the cards whose score values are x, x; 
and хз. More generally, we write the score-sum of the r-fold non-replacement sample as 


чет 


Sa Dake . . . . D ze) 


u-1 


If we do replace each item before extracting another, we may write the first four moments of 
the 7-fold sample distribution of the score-sum S, as in the derivation of (xiii)-(xv) of 19.03, viz. 


ш(5,) = т. E(x,) " К * 5 a 5 ^ ^ x . (i) 
ш(8,) = r.E(x) Hr .E(x,.x,) . а А ; 5 2 . (iii) 
px(S,) = ғ. E(x) + 8r'9 . E(x .x,) + т). Е(х„. xo Xo) $ 3 . (iv) 


BS.) = ғ. E(x) + 492. E(s3 х,) 3н. E(x? . 22) 
+609. Е(2.х,.х.) Hr”. E(xu x, xu.) « . @) 
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Now the coefficients of E(x%), E(x% . х"), etc., in the foregoing expression correspond to 
a summation of like terms on the assumption that E(x), E(x% . х"), etc., have the same value 
regardless of choice-order, e.g. E(x$) = E(x) or E(x. х1) = E(xi.x1) We have to establish 
the truth of this conclusion before we can employ (ii)-(v) to evaluate the moments of the non- 
replacement distribution. 

In 12.02 we have in fact already shown that 


E(x) = ii E) = ра; Eley х) =p — zt 


We shall now generalise the argument employed in 12.02 to establish the conclusion that 


(a) order of choice does not affect the mean value of the kth power of the unit sub-sample 
score when sampling occurs without replacement ; 


(b) order of choice does not affect the mean value of a co-moment of given order on the 
same assumption. 


First, let us be clear that х is the Ath power of the unit sample score at the uth draw, whereas 
xt. x” is the product of the kth and mth powers of the component score of the 2-fold sub-sample 
consisting of an item extracted at the Ath and an item extracted at the mth draw. In the same 
way xt. x". x? is a score referable to а 3-fold sub-sample. Thus x; may be numerically equal 
to д.д, if х= x, OF tO Xy. XV. Xu, if x, — x, — xu, but E(x7) will not in general be 
numerically equal to (хі. х" *). 

As in 12.02 our model for what follows may be a pack containing no picture cards. Having 
extracted from a pack of л cards an r-fold sample which we distinguish from those which remain 
by the choice-order subscripts 1 to 7, we may turn the remaining (л —7) cards of our model 
pack upwards in a row and label the score of each by its order in the sequence regardless of 
its numerical value, starting with x,,, and ending with x,. If we then denote the sum of the 
scores of this residual universe by 5 „у: 


Sco c rele с) > Mea =. "us <(vi) 
u-rkl 
On this understanding we can identify each item in the universe of л cards ; and we may denote 
the sum of all the score values as 


Ses (ж Б ЕА. Бк) = > 5 * ^ ‚ (vii) 


ч=1 
In the same way we may denote as the sum of ће Ath power of the scores in the r-fold sample, 
the (n—r)-fold residual universe and the universe as a whole by 


u-r чеп чел 


Su» = > 3 Shiney = 5j ais Sin = > и. . + (viii) 


u=1 u=(r+1) u=1 


In this symbolism, the Ath zero moment of the unit sample distribution is by definition 
1 
n= PI UC ER З 9 : : . (ix) 
We shall now suppose that we have already extracted without replacement an (a-1)-fold 


sample, so that the sum of the kth power of the scores in the residual pack of (n — a + 1) cards 
is in this notation S; 4,5. The next draw is the ath and the score drawn is x,. If we have 
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HISTOGRAM FOR 2-FOLD 
THE CARDPACK SAMPLE WITHOUT REPLACEMENT 


CHESSBOARD FOR 2-FOLD SAMPLE 


gnooms 


Б г ДЕ OW Н 
MEM HHI 
JLo: 
LE 
KT 
H 
Н SUM (X) 
T MEAN (x/2) 15 2 25 3 
rreauency 5 5 3 $ 


Fic. 124, Sampling without Replacement in a Finite Universe. 


"The universe consists of 6 items to which we attach the values 1, 2, 3 definitive of the score class with relative 
frequencies 1:3:2, In drawing an r-fold sample, we can take any item once only, but we may draw more than 
one item of the same score class if the class itself contains more than one. To keep track of what we have taken, 
we distinguish members of the same score class by suit. The reader may complete as an exercise the chessboard 
and histogram of the 3-fold sample and thus show that the half-universe sample (F = $) has a symmetrical distribution. 
The score sums (X) are 5, 6, 7, 8 with relative frequencies 18:42:42:18. For X = 5 and X= 8 there are 18 
ways of taking the combinations 1, 2, 2 and 2, 3, 3 respectively. For X — 7 and X — 8 there are 36 ways of taking 
the combinations 1, 2, 3 and 2, 2, 3 respectively, and 6 ways of taking the combinations 2, 2, 2 and 1, 3, 3 respectively. 
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not replaced the sample of (a — 1) cards previously drawn, the mean value of xi is the mean 
value of the Ath power of the score from a residual universe of (n — a + 1) items, i.e. 


М _ Е[Зщп-а+1›] 
Geet ieee i at. Иш к (x) 
If we draw again, the score of the next card taken is x, = хаз, and the sum of the kth powers 
of the scores in the residual universe from which we take it is S пазу — x» and this residual 
universe consists of (n — a) cards. For a fixed value of x, we may therefore write the mean 
value of 22 as 
Sx п-@+1) — 2 


a 


E. “(%) = 
We may now employ the customary grid operation : 


E(xp) = E, - Ey. ol) 


Bluan] ED 
||  "—aà n—a 
Whence from (x) : 
Ej[Sus-] —— Ed Sinn] 


E(x) n—a (n — a(n—a4- 1) 
Es) = EBen] L кд), 
у. Еш) = E(t), 
CHEE . . . T UN S 


We have thus shown that E(x) does not depend on order of choice. For the first term 
in (ii)-(v) we may therefore write r(u4). To evaluate an expression of the form E(x% . xj") we need 
therefore place no restriction on the value of b other than that it lies in the range 1 to r excluding 
ain the same range. On that understanding we write 


E(xi . ху) = Edi - Ev. (ху)]. 


In this expression E, . a(x) is the mean value of xj" associated with a fixed value of xa, i.e. the 
mean value of the unit score of a pack from which we have thrown out the card whose score 
value is x,. The pack so defined contains (n — 1) cards and the sum of the mth powers of the 
unit scores therein is (Smn — a7), so that 


Sinn — X n 
Ey. le) n—1 ЖУО ЕЗ i^^ 
n 1 
cox ET) = qum LI qn 


^ Eit В, р) = ie Е) — 1 БДИ"), 


n 1 d 
^ Eg ху) = Lh m рант о ОШ 
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We may write this in the form 
n? n Е 
Ш.т = НЕ. Ит — ву Мант > . . . ‚ (хш) 
In the same way we may write 
Е(х. ху”. хр) = Eq. Ey. ole» х9. Ec. (х). 


To interpret Es. a(x?) we recall that we sample from a pack from which we have thrown out 
Xa and хь, so that 


‘Syn — 98 — of n 1 cd 
Een n—2 РЕ UD 


^ BCE рор) = gs Ba Est D) — Е, Ba ast *7 ap) 


1 
> aaa + Ey. (хд. 077). 


In this expression 
E, . Ey, (ай. х7) = Ех. En. a- (35')] = Е(хй. ху) = ра. 
Whence from (xiii) 


n? n? n* 
к.т. = gg) Pk Pm: Fo — зу Pim «Hp — ug) Pro Pm 


n? 2n 7 
— Lg к: тър + a) Шатр (Хі) 
n n 


In the same way we derive 


1 
Ix st = ghe Бк.) — ВОМ. ар. А) 


x 1 
AE E(xk . xt. xP) — as E(k. xf . ТМ) 
3 a * b Б. 3 wp ry 


n 1 1 
= ag т.о ap gem) 7 p3 emas y og P eme 


Hence from (xiii) and (xiv) we derive 
1 
Вто = (туз [азр ноша — N? Краун  Paltsleosm 


F ыраш» рано F ошта Ноор 


+ траат Шта F Bicaltssm 
+ Эрат + иньо + 2Upliaemsa 
+ nsum) — Ones - . . . . (xv) 


SAMPLING IN A FINITE UNIVERSE AND MANIFOLD CLASSIFICATION 819 


From (xii), (xiii) and (xv) we thus derive the following co-moments : 


ee n 
h. = Tal 7 quii 


п? п. 
На. = wg He — plas 


ый n? 2 ue H 
bs. = gn 7s 
n* no 
На = wait Ha удаа? 


1 
Haa = qan — Эли; + 2n а]; 


1 з 
Bia = Wa) [ripa — 2л? — n*u$ + 2n . н]; 


1 2 
Mid golei — Gn gui + Зп + Sn% 2,45 — 6n . pa]. 


The reader will note that every term except the first in the above expressions vanishes when 
n is indefinitely large, so that the replacement condition is irrelevant and pu, » = pu. p, Etc., 
as when replacement occurs, e.g. 
~ иќ 
Pria ^ш. 


We now recall the general expressions for the first four zero moments of the r-fold score-sum 
non-replacement sampling distribution in terms of the zero moments of the unit sample dis- 
tribution and of the above co-moments, viz. : 


B(Si) = 7ш; 

(5) = тра + 1915 

Ha(Stry) = тиз + Зи p. yas 

HSin) = та + 423.1 + Заз + Grea, + pa aaa 


Hence we have 


ња) = ris "b È E Dind s | 
= e — Du + nr. 


If m, is the variance of the unit sample distribution, the corresponding mean moment of the 
Score-sum distribution is therefore 


mS) = zl ра + {nr — 1) — rn — Dy 


r(n— r) 
n—1l"' 


os MS) = (xvi) 


2 
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Similarly, the third zero moment of the score-sum distribution is given by 


3r» po 
Hal Sir) = тиз + = jram ња] + a-yo Зп. papa + 23] 


3—1) 20 1007—90], Barm, N], „ 79 a 
nol n—1 (п 1и 2) (9—1) [-Ё= |+" 


r(n — r)(n — 2r) Sn(n — ry'? Ио 
(n—1ys "^ t (y — pear Male y — pat 


Whence we derive by the customary conversion formula 


тб) = “©су нз — Sate + 48 


+ тва) = EDO m. М yi) 


In the same way, we get the fourth zero moment of the r-fold sampling distribution of the 
score-sum 


(5) = та "= [иш M+ 5 = зт [лиф — ња) 
Gr, Я 
+ a-yo” Hille — 2npyus — np + 214] 
taye Dy — Gn*nui + Элиф + Ships — бш] 
= Ge ple — 20 — 9) — nt — Ds 
Anr™ 
луш — 20 — 8) — 9t — 2n — 8) + Ur — 2 — Зна 
A xs ulpa + E 
Snr) P 2 
*g galt -20—3 — т — 208—3) +07 — 2907 — 3) 
GE palin — 20e — 3) — ne — а 
р 4n(n — s = at ye 2 z= мн 


nm Bn . r'?(n — r(n — r — 1) 
+G—pert (n — 19 3 
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"The derivation of the corresponding mean moment is elementary but rather tedious, and it 
will suffice to give the result 


r(n — ry (n an а n(r DI | M AR 1) Lo quy 


т{(5)) 


From (xvi)-(xviii) we obtain in the usual way the first two Pearson coefficients of the r-fold 
score-sum distribution in terms of the Pearson coefficients of that of the unit sample, viz. 


(n — 1)(n — 2r} 
В) = а 2n — уу Lx 


PAS 0) =a rs — e 2089) -a-r epar, 09 


(xix) 


If n is so large that we can neglect Эл, we may simplify as follows the above by the substitution 
of the sampling fraction F = тї: 


(Sn) = 20 s CS PEE 725 


Tekin). 8 


BS.) =3+— p h; 


- (xxii) 
The first expression vanishes if F = 3, suggesting that the distribution becomes symmetrical 
even if the parent universe is skew. We have already seen that this is so of sampling without 
replacement in the taxonomic universe of 2 classes. For the more general case under discussion, 
the symmetry of the distribution when F = } follows from elementary principles, if we bear 
in mind the fact that each combination of a out of n letters corresponds to the same number, 
i.e. л“, of permutations. Hence the frequencies of score-sums will be in the same ratio as the 
numbers of combinations of items whose total score is the same. If а = 4л, there will be a 
unique combination with score-sum 5, — s,, for each unique combination with score-sum sqa). 
Thus scores of Sta and S, — Sta) will occur with equal frequency when a = фт. The mean 
score-sum is then 1S, and the deviation of s; therefrom is (s) — 45n) = + Sq. That of 
each corresponding combination whose score-sum is (S,, — 5а) will be 


(S, — s — Sn) = (Sn — Sta) = Suy 


Thus score deviations of + Sta) and — Sra) must occur with equal frequency. 
When F=}, we have 


B(S) = 0 and (5) = 3 — - (xxiii) 


Вз +3 
UC 


The expression on the right indicates that the distribution is necessarily platykurtic when F = 4, 
as is true of the symmetrical Type II distribution. If we substitute for j in (xx) of 15.04, we have 
33800-69) 
2B, +3) 


How closely this conforms to the restrictive condition mentioned at the end of 19.01 evidently 
depends on the character of the unit sample distribution. More generally, £,(S,,)) vanishes 
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for all values of F if 8, = 0; and B,(S,;) may be greater or less than 3. If F is small and т 
is large, (xxi)-(xxii) approach the limit for the replacement set-up, as we should expect, i.e. 


PlSin) lf, and (Sin) 23 + S. 


: d 


24-fold Symmetrical Universes of 3 classes. 


UU 


=I *| = 

Noo 10 4 0 але 
8215 BENT Az 20 
“О +j -j +1 3j +1 
Nos. 8 8 8 710 7 6 g 6 
4-24 4-0 44-40 
x - 1 О + -! 1 
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4-60 44-120 Ae? 

1 LU 

б, 
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! П 
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pu 

I I 
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X То + -| O 4 ао d 
Nos 2202 1 22 I 0240 


Fic. 125, Symmetrical 24-fold Universes of 3 classes with kurtosis (8,) coefficients. 
Note the scale is not uniform throughout. 
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1з 
SAMPLING WITHOUT REPLACEMENT FROM A 

1 3-CLASS UNIVERSE OF 24 ITEMS 9 
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Fic, 126, Variation of kurtosis coefficient (,) with size of sampling fraction for 24-fold universes 
of 3 classes shown in Fig. 125. 


= o 
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For small values of F, we therefore expect that the score-sum distribution will be leptokurtic 
only if that of the unit sample is also ; but if F is large, the score-sum distribution may 
be leptokurtic if that of the unit sample is platykurtic. In the limit, of course, B; (Si) becomes 
infinite, since only one value (S,) of the score-sum is consistent with exhaustive sampling. 

A closer examination of the approximate formula (xxii) brings into focus what is perhaps 
a more remarkable feature of non-replacement sampling distribution than the symmetry of the 
half-universe sample. The expression 1— 6F(1 — F) vanishes when F = } + 1/V12, i.e. 
F = 0-22 or 0-79 between which limits the coefficient of £, in the second term of (xxii) is negative 
with a numerical maximum for F~0-59. Regardless of the structure of the universe, the 
sampling distribution will always be platykurtic unless the sampling fraction in round numbers 
is greater than four-fifths ; ceteris paribus, below this level a highly leptokurtic unit-sample 
distribution will generate a more platykurtic sampling distribution than a distribution which 
is initially flatter than the normal curve, e.g. a rectangular or indeed even a U-shaped one. At 
Е — 0:59 the kurtosis is a minimum and (xxii) is approximately 


3 + 11g, 


r 


a 


This seemingly paradoxical characteristic of any non-replacement distribution comes into 
focus (Fig. 125) if we calculate from the exact formula (xx) the kurtosis for samples of different 
sizes extracted without replacement from a symmetrical 24-fold universe of only 3 score classes. 
For simplicity, we may assign to the З classes scores of — 1, 0 and + 1, and frequencies (pa, 
Pw Р.) as below with B, values for the unit-sample distribution in the range 1-12 including 
a rectangular and a U-shaped contour at the lower limit of kurtosis. 


E 0 +1 Bs —1 0 +1 Bo 
1 21 1 12-0 5 14 5 25 
2 20 2 6-0 6 12 6 20 
3 18 3 40 8 8 8 r3 
4 16 4 30 1 2 11 11 


The picture disclosed by Fig. 125 raises the question: what lower limit may £,(Sj,)) attain if 
В» is as high as may be ? This admits no simple answer because the size of the universe itself 
sets a limit both to the maximum value of f, and to the value of r consistent with the condition 
that the second term in (xxii) is both negative and numerically maximal, as when F œ 0-6. 
Thus a universe of 100 items assignable to 3 equally spaced score classes ( — 1, 0, + 1) as 
above cannot have a kurtosis greater than 50, and the sample size consistent with a minimum 
value of B(S) is about 60. 

For the rectangular universe В, = 0 and 8, œ 1:8 when л is large. The possibility of 
generating a rectangular sampling distribution therefore implies that 3 + 1:16, = 1:27. If 
n = 200 and F = 0-6, r = 120, so that В, could satisfy this relation only if 8,2130. For 
the 200-fold binomial universe defined by (0-995 + 0-005)', В, exceeds 130 but no other 
binomial 200-fold universe and no 200-fold universe of more than 2 non-zero classes can 
satisfy the condition В, > 130. From a 2-class universe of 1 zero score value and 199 unit 
score values the value of 8,(S;,,) for the 120-fold sample would be 1-12; but the sample itself 
would contain only 2 score classes (viz. score sums of 120 and 119) as we see by expanding 
(199 +1)", Though a(S) is in this case less than 1-8, the distribution of the sample 
score is monotonic. 
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From (xix)-(xx) we see that the first two Pearson coefficients of the 7-fold and the (n — 7)- 
fold sample are respectively identical. Thus &((Si5) = Ву and В,(5,)) = Bz when r = (n — 1). 
If f, lies in the neighbourhood of 3(n — 1) + (n + 1), the kurtosis of the r-fold distribution 
does not appreciably change within the range r = 1 tor = л — 1, e.g. when л = 24 and B, = 276 
(Fig. 126). 


19.05 DIFFERENCE DISTRIBUTION FOR NON-REPLACEMENT SAMPLING 


То derive the distribution of the difference between the raw scores of an a-fold and b-fold sample 
from the same finite universe we must retrace our steps to the derivation of (ix)-(xii) in 19.03. 
We there considered the form of the terms of the expansion of a multinomial expression such as 
(p+q+r+s...)" containing m basic terms p, q, 7, etc. all positive. For the (a + 6)-fold 
score-sum the expressions K; o, Kı.» etc. are obtainable by inserting (a + b) form. We may 
write the raw-score difference in the form 


D=(S1.a + ¥2.0 + + Xi) — (ro a Б) 
= (ха H Ха... F Xaa — Xio — X +> — y.) 
whence the Ath zero moment is 
(а 5р6 = E(X, a + Ха... — Xio — Хз»... J 


The expression on the right has a positive and b negative terms within the brackets; and we 
may classify the terms of the expansion as in the derivation of (ix)-(xii) of 19.03. The coefficients 
of corresponding classes will not be identical with K, 9, etc. Accordingly, we shall label them as 
H, œ etc. The reader should first note that the correct interpretation of (a — b)“ is consistent 


with Vandemonde’s formula, if we write it as 
ker 


(a =) by? БЕ Xraa*(— byr-". 
kai 


This would be strictly analogous to the ordinary binomial expansion (a — b)" if it were 
true that (— В) —(— 1)*. 59, For brevity, it is convenient to define by use of square 
brackets an expression which precisely conforms to the analogy, vis. : 

ker 


(a = Бү! = bx (- 1)¥ray) „а'® bt, 
ii 


The reader may check that the pattern for the H coefficients is as follows : 


Hy, =(а +b), Н.о =(a +b), 

Hı =(a— by, H,, =4(a — b)”, 

H. =(а — b), Bes =a b), 

H,, ==За'® — ЗЬ, Нлл =6[a® — Ва!) — ab! + 59), 
H, 4a (а — b)”, Hyaaa = (a — b)". 


We may then derive, by recourse to the H coefficients defined above, compact expressions 
for the moments of the raw-score difference distribution in terms of the moments of the u.s.d. : 
(«fa = (a — bin, 
(аура == (a + Б) + (a — b) Pui 
аура = (a — b)us + 3(a® — Б). + (a — В), 
«na = (а + Бу + Җа — D)? ua + (a + b) tad + 
6(a'*! = Ьа"?! ч ab?» + [ЫТ А и + (а -— Буи}. 
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We thus derive the following expressions for the first two Pearson coefficients of the raw-score 
difference distribution in terms of those of a u.s.d. referable to л items : 

(a — b)? (n? — 3n(a + Б) + 2(a — by*y*(n Ds 

(а +b) — (a — (л — 2* : 
(n — [s(n — s)(n(n + 1) — 6s(n — s)) + 16ab{n(n + 1) — 3s(n — s) Gab], 
(n — 2)? tin — з) + dab}? : 

s Sn? [s ? (n — s) + Sab(s(n — s) + 2(ab — n + 1)}] 
(n — 2)? (s(n — s) + 4ab}* 


ЕЛ 


ағ 


in which s =a + b. 


Both expressions simplify greatly, if we choose samples of equal size (a — 5), in which event 


(o-» By =0 
and 
B. CREE Te — ба) + n + 6ajf. 
(aoe Zanfan — 2) m А 
З(п — 1 
"gus Qa — Dn — 2a) + ваҷи— a) — Bain — 0) 


If a = n(n + 1) + 6(n — 1) = b, it is thus apparent that the difference distribution is 
symmetrical; and the value of the second Pearson coefficient is independent of В, i.e. of the 
structure of the universe. On substitution of this sample size in the expression above we find 
that („68 reduces to 3(n—1) + (n + 1); but the interpretation of this result is meaningful 
only within the framework of the assumption that both л and a must be integers. Evidently 
the coefficient of £, will be small if n == ба, i.e. each sample is a one-sixth fraction of the universe 
of choice. For large values of л we may thus say that an overall sampling fraction of one-third 
will ensure that the kurtosis of the difference distribution is independent of the kurtosis of the 
u.s.d. More generally for n = 6a, („Ё reduces to 

6(n—1), , 3(n — I) n* — 6n + 6) 


п a n^ 


The maximum finite value of £, occurs in the binary universe, the frequencies of the classes 
being л! and (n — 1)n™ respectively, one class being then represented by only one number. 
The second Pearson coefficient of its u.s.d. is (n? — Зл + 3) + (n — 1). This is its maximum 
value; and the maximum value of („Ёз is therefore exactly 3. Thus the difference dis- 
tribution is necessarily platykurtic and the greatest contribution which can be made by the term 
involving B, is 6(n? — Зл + 3) + n(n — 2). The table below shows for various values of л 
the values of the two terms іп („Ёз assumption that £, has its maximum value, as above. 


Ist 2nd | Ist | 2nd 

n n 
term term term term 
6 1-75 1-25 30 0:21 2-79 
12 0:62 2:38 42 0-15 2-35 
18 0-38 262 60 0-10 2-90 


24 0:27 273 96 0-06 2:94 
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Even if the u.s.d. of the binary universe is very platykurtic, we therefore see that samples 
of size equal to th of the universe will generate a symmetrical difference distribution having a 
second Pearson coefficient greater than or equal to 2-8 if n is greater than or equal to 30. For 
any universe of 30 or more items, regardless of the number of score classes and of items in each, 
there is good reason to assume that the first two Pearson coefficients of the distribution of the 
difference referable to equal samples of }th will lie close to their normal values. However, 
this does not suffice to justify the conclusion that the normal curve will give an adequate 
quadrature for the sample difference distribution. An examination of how gratuitous such an 
assumption may be will indeed give us some insight into circumstances which guarantee a 
good fit. 

In particular, we recall the case of sampling from a 2-class universe. Without restriction 
on the values of a and 5, the difference distribution is then definable as follows for a u.s.d. of 
score values differing by unit increment 


Difference Scores. В А -1 0 T1 
—a-— b 

Frequencies. š А К g Еа 0 - 
n n n 


When a =b and F = (a + b) — п is the total sampling fraction, this reduces to 


Difference Scores Я P 5 —1 0 T1 
F 
Frequencies : Я z ‘ 5 1=F 3 


Whence (, 8, —0 and „68. —30 if a =b and F =}. 
"The difference distribution is then a special case of what we have elsewhere called (14-05) 
the burette universe, vis. : 


Score . Е 5 я a —1 0 +1 
Frequency : : : : i H i 


We may here make use of results obtainable (14.07) from sampling in the burette (infinite discrete 
S-class) universe by stating at this stage without proof the following conclusion: when the 
first two Pearson coefficients of a distribution involving 20 score classes are very close to their 
normal values, we may confidently invoke the normal distribution for purposes of quadrature 
adequate for statistical usage. It is therefore immaterial to examine the implications of the 
foregoing formulae for „ё, and „6: more closely. It suffices to state of any finite 
unimodal universe that : 


(a) the first 2 coefficients of the non-replacement difference distribution w.r.t. a-fold and 
b-fold samples will lie very close to their normal values if both the following conditions hold 
good : 


(i) the sample sizes are equal (а = b) ; 
(ii) the total sampling fraction (F == (a + b) + n) is in the neighbourhood of one-third ; 


(b) the normal curve will then give a satisfactory quadrature if the distribution of the a-fold 
sample is referable to at least 10 different score values. 
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19.006 THE SO-CALLED CHI-SQUARE STATISTIC 


In Vol. I we have sufficiently clarified the distinction between two methods of scoring respec- 
tively referred to throughout this book as taxonomic and representative. When we score by 
the former method we specify a sample by the number of individuals in each of an exhaustive 
set of exclusive classes. When the classification is binary every individual belongs to class A 
or to class B. If there are a individuals of an r-fold sample belonging to class A, there must 
therefore be (r — a) = b individuals in class B. Conversely, а = (r — b); and one score 
suffices to define a sample of known size. For example, it is immaterial whether we specify 
a 12-fold sample of peas classified as green and yellow by the fact that it contains 5 green or 
7 yellow. 

When our concern is with more than two classes, this is not so. If there are N classes, 
our knowledge of the r-fold is not complete unless we can specify the score of (N — 1) classes. 
For instance, we can exhaustively specify one and the same flock of 25 Andalusian fowls classified 
as white, black and blue in three different ways, viz. : 

() (i) (ii) 
White 12 White 12 Black 7 
Black 7 Blue 6 Blue 6 


To avoid periphrasis, we may speak of a classification involving more than 2 classes as 
manifold. The problem we shall examine in this chapter is the correspondence between hypo- 
thesis and expectation in a manifold system. Thus we might wish to know whether the com- 
position of the 25-fold sample cited above is statistically consistent with the requirements of 
the Mendelian ratio: 1:2:1 for white, blue and black respectively. 

We can, of course, specify the probability (P) of getting a sample of a given composition 
by recourse to the multinomial theorem in ordinary (replacement) or factorial (non-replacement) 
powers. For our Andalusian flock the data are 


White Blue Black Total 
Observed numbers . Е . 12 6 of 25 
Unit-sample expectation . e 4d + i 1 


On the assumption that the universe is indefinitely large, we consider that we are sampling 
with replacement and put 


25! 
P= gig; OOW. 


In dealing with a 2-class system, we commonly specify unit sample expectation w.r.t. 
choice of an item of class B as g = (1 — p), that of a choice of a single item of class A being p. 
In a manifold system of more than 2 classes, no such unique relation exists between the unit 
sample expectation w.r.t. class Æ and to class B. Accordingly, we shall write the unit sample 
distribution for a system of N classes as 


PatPotpe+++ + 


In this expression p, is the unit sample expectation w.r.t. class A, and (1 — p,) = ga is the 
expectation that a choice of a single item will not belong to class 4. Where occasion arises, 
we may write qa = (1 — P»), qe = (1 — рф), etc. For а 3-class system therefore 


р.= (1— р. — ра) and g= patho - . + + @ 
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When our concern is with the expected, i.e. mean, value of a score referable to one class alone, 
the classification involved is essentially binary. For instance, an item either belongs to class C 
or does not belong to class C. If f (b) is any function of the raw-score distribution of the B-score, 
we may thus write its expected value as for a binomial variate, viz. : 


E.f(b — 2 f(b) FE pee ee ee seri) 
In particular, we may write 
СЕ) 
E(b — М) =r . p(l — р) = Eb — r . po} - : : : » (iv) 
E(b*) = r. pl — рь) + rbi = rito + BS iia xo) 


In what follows we shall thus adopt the following schema for a 3-class system : 


Class A B [^] "Total | 


| Unit Sample Ex- 
pectation Pa Po Pe (Po + Po + Pe) = 1 
| Observed Nos. a b с (a+b+c)=r 
Expected (Mean) 
Nos. M, = т, М, = ть М. = т, (M, + М+М) = 
| ‘Score Deviations u = (а — M.) v= (b — М) tw = (с — M) (и+о +) = 0 
Н 


In the symbolism of the foregoing schema, the probability (Р„ь) of getting the particular 
set of score values a, b, c defined above is 


(a) With replacement : 


т! 5 " 5 
p иа pe. ph. ps . " 5 . (vi) 
(b) Without replacement (from a universe of n items) : 
71 (nba) « (np)? - (np) i 
Pare = qa P A ee) 


In practice, we must assume that the choice of any one such set of score values is trivial 
if ris fairly large. What we want to assess is the overall probability that the score deviations 
u, v, t will not be excessive. With this end in view our task is to devise a manageable statistic 
which brings score deviations of all the constituent classes into the picture. We can get a clue 
to the fulfilment of this aim, from the customary procedure for assessing the expectation of an 
excessive discrepancy between hypothesis and expectation, when our concern is with only two 
classes. Our system is then : 
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A B Total 

Unit Sample Expectation Pa Ps (Pa +p) =1 
Observed No. . . a b (a+b) =r 
Expected Nos. D M, — rp. M, =, (M, - My) = 
Score Deviations. — . и = (a — M.) v-—(b—My) ute =0 


The statistic commonly prescribed when our taxonomy is binary is the standard score here 
denoted as c}. Except when either p, or рь is very small, its replacement distribution for large 
samples is approximately normal with unit variance, its square (C;) being then approximately 
a Chi-Square variate of 1 d.f. We define it by the equivalent alternative relations 

u? v? мү 
= С, = : viii 
by © Thu и 
"The identity so stated depends on the following relation which suggests an alternative definition 
of C, involving both u and v : 
u =a — rpa = (у — b) — (1 — рь) =), — b = — v, 
NE 1 1 
~ (a— М.) =(6—M,)?; —+— =—, 
à bd E NN s 
dt rut и? u? meia 
+ — = — = — 
rb. TP, тарь "Pa uis 
CET (= ; 
M DEN. x * $ ё "a x) 

Since the binomial statistic C,, elsewhere denoted c*, is an approximately Chi-Square 
variate of 1 d.f., its expected value (first zero moment) is unity, as we see from the following 
considerations. The expected value of (a — M,)* = u* and of (b — МУ)? = v? is the variance 
of the raw-score distribution, i.e. 

E(u) = тр, = Бо?) 
E(u*) | E(v? 
^. ЕС) 22 5 н 2 


-Q= 


= рь р, = 1. 


І we write а — x, апа b = x; to make (ix) s as a particular case of a more general 
expression, it takes the form 


.=2 (x, P Bx». 
= 
s-1 M, 
This suggests a statistic which we may define for a system of N classes as 
s=N х. — М 2 
Cy = у ee e) 


It is easy to see that the expected value of (x) is N — 1, i.e. that of a Chi-Square variate of 
J= (N — 1) degrees of freedom for all values of N. This follows from the fact that any manifold 
system can be regarded as binary, w.r.t. any one class. Thus (1 — р.) is the probability that 


— 


SAMPLING IN A FINITE UNIVERSE AND MANIFOLD CLASSIFICATION 831 


a unit sample will not belong to class S, if p, is the probability that it will do so ; and rp,(1 — р.) 
is the expected value of the square score deviation (x, — M,)?, i.e. the variance of the distribution 
of the S-score. Hence we may write 


E(x, — M,)* = rp(1 — р.). 


Since M, = rp, 
s=N = 
E(Cy) = > 0-9)-N- X р. 


By definition 
(b. bb py)=1, 
“у= 0. 2 o9 . o QE) 


Thus the statistic C, of the binary system is a particular case of a more general pattern 
which takes account of score deviations of all the constituent N classes, and the expected value 
of this statistic is that of a Chi-Square variate of N — 1 degrees of freedom. For the 3-class 
replacement system whose general term is (x) above 
JS |, tet E 

=; + М, + М, г A . . . (xii) 
In this case, N = 3 and (N — 1) = 2 = E(C;) ; and we shall later explore the possibility 
that C, is in fact approximately expressible as a Chi-Square variate of 2 d.f. The procedure 
will make it sufficiently clear that the rule suggested holds good when N > 3. 

It will clarify our task if we first re-examine the implications of the statement that the 
square standard score deviation (C;) of a binomial distribution has approximately the distribution 
of Chi-Square for 1 d.f. We have previously arrived at this conclusion by the following route : 


(i) The distribution of the score deviation (a — fpa) = u tallies closely with that of a 
normal variate with variance rp,(1 — pa) for large values of r unless p, or 1 — pa is 
small compared with the reciprocal of r, i.e. for large values of r and rp, > 10; 

(i) Subject to the qualifications stated, the ratio (c) of u to Vrp,(1— Pa) is therefore 
approximately a normal variate of unit variance ; 

(iii) Since the square of a normal variate of unit variance is a Chi-Square variate of 1 d.f., 
the ratio of и? to rp,(1 — pa) is also approximately within the framework of the same 
qualifications a Chi-Square variate of 1 d.f. 


C; 


Let us be clear that we are not speaking of the exact distribution of C, = с? in these terms. 
Accordingly, we might regard the problem as that of finding a good fitting curve for it by the 
method of moments. Now we have seen in 13.01-13.02 that the following relations hold good 
for the mean moments of the normal variate (c) of unit variance, and the zero moments of the 


Chi-Square variate (C) for 1 d.f. : 


nC) = malo). 
In this expression, we have seen that m,(c) = 1, m,(c) = 3, т(с) = 15 and m,(c) = 105. Hence 
wx(C)=1; (С) —3; w(C)= 15; n(C) — 106. . — . (хш) 


If C, defined by (ix) above is a statistic for which we seek a fitting curve, we may proceed to 
determine its moments as follows : 


u? _ vV E(u) , E(v) , 2E(u* . v?) 
«(су = Eco = BF + у) = AD p HOD Oe. 
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Since u? — v? in a 2-class system, we may here put 


E(u’) 


мс) = уку: + Mp аммо = COT MY 


мм; 
In this expression E(u*) is the mean value of {һе 4th power of the raw-score distribution of the 
binomial distribution, i.e. its 4th mean moment (тц). Also 
(M, + М)? —7* and M;M; —r'Pi — pa)’, 
‚ (Ma + Му)? _ 1 1 
CO MMi Pp) т 


еш) = Fe = Pe 


In 14.05 we have obtained the value of 8, for the r-fold sample from a universe whose unit 
sample distribution is (9 + p)', viz. : 
ay =, 
7р4 

Evidently, the second zero moment of the C, distribution tends to 3 when r is large and the 
reciprocal of either pa or pẹ is small in comparison with 7. In the same way, we may sce 
that „(С and (С) approach the values of jj; (C) defined by (xiii) above. The numerical values 
1, 3, 15, 105, for the particular case f = 1, i.e. the Chi-Square variate of 1 d.f., illustrates the 


more general rule : 


m=f; gf +23 n-f-2-9; 
pa = ff + 2) (f + 4) (f + 6), ete. 


The statistic defined by (xii) is referable to a 3-class system, and the hypothesis we are exploring 
is that its approximate replacement distribution for large samples is that of a Chi-Square variate 
оЁ (3 — 1) =2 4. If f —2 in the above 


pr =23 m —8; uy 48; p, = 98A... . (ку) 


We have already seen that и, = 2, when № = 3. We shall now explore the possibility that 
the limiting values of ps, etc., for large values of ғ conform with the above. 

Before proceeding further, we may pause to refer to an ambiguity of current terminology. 
Pearson developed the theory of the distribution referred to as the Chi-Square distribution 
on the assumption of continuous variation ; and it is in that sense that we speak of a Chi-Square 
variate elsewhere in this volume. The exact distribution of the function of sums of squares 
defined by (x) is necessarily discrete. Accordingly, it is misleading to speak of Cy in (x) as a 
Chi-Square variate, and a fortiori misleading to define a Chi-Square variate as a sum of squares 
so weighted. What we can say is what we have already found reasons for suspecting, viz. that 
the Chi-Square for (N — 1) degrees of freedom is a good fitting curve for the sampling distribu- 
tion of Cy when r is very large. Only on that understanding can we use the table of the appro- 
priate Chi-Square integral with propriety to evaluate the expectation that Cy will exceed a certain 
numerical value. 
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19.07 THe MOMENTS OF THE SO-CALLED CHI-SQUARE STATISTIC 
We may write the statistic defined by (xii) in 19.06 in the form : 
(a — M,)? "n (6—M,)? , (c— M 


eo M, M, ; M, 
a? b: b 
= м, tI E +9 + (M, +M, + M) 
a b с? 
Tm tmt” 
b (5d 
с, E 
27 = Ma 


Whence we may put 


KG, Et и +), 


M, M, M, 
^ RC) + (C) +r 2 + 0) д) 


2E(a*b*) + enr 280107) 
M.M, М.М, TM ъМ,` 
In the preceding expression, E(C;) = 2, being the mean value of C, as already shown. 
The expression E(a*) is the 4th zero moment of the A class score, and we may write it accordingly 
as ш(а). For brevity we may also write 
E(a*b*) = p, s, o; Еа?) = Hz.0.25 E(b%*) = ро.з.2 
Thus the foregoing expression reduces to 


(с) = МӘ D „МӘ „Жене y Mana p Mata и>, б 


'The hypothesis that the Chi-Square distribution for 2 d.f. is a satisfactory fitting curve for the 
3-class statistic C; requires inter alia that 


u(C)zf(f-2)—8 . 2T at cam TON 
To evaluate the variance of the distribution of C, as defined by (i) it is necessary to find 


expressions for ps,2,% etc. More generally, the evaluation of higher moments presupposes 
that we can find expressions for 


+ 


Bag = E@. H.C). 
Since we can express с = (r — a — b) in terms of a, b and r the fixed size of the sample, we 
can always transform co-moments of the above form to the simpler pattern illustrated by the 
following : 
2.2.2 = E[a*b*(r — а — By] 
= E[a*b*(r? + а? + b? — 2ra — 2rb + 2ab)] 
= r*E(a*b?) — 2rE(a*b*) — 2rE(a*b*) + 2E(a*b®) + E(a!b?) + E(a?b^), 
7 Ha 2.2 = Тра, а.о — 2rjta 2.0 — 27ра.з.о + 2ра.з.о + Ha.e.o Hea + (iii) 
It will thus suffice for the purpose of evaluating moments of any order, if we define ph, ;. o- 
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We can do this directly by recourse to the grid symbolism of 11.01-11.04 employed in our 
treatment of the two card-pack model of 12.03; but it will be instructive if we also perform 
the operation by recourse to first principles. "The general term of the distribution which defines 
the r-fold sample frequency of the particular score values a, b and c is 


7! a b E 
ава?" + Po Ре 
If we write pa = (1 — qa), 
"auc 


9 qa qa 
Hence we may put 


An ne 7 ara (r— 2)! (D) (P " 
анай: аа) Pele” на (2) (9 eet) 


By definition, the mean value of abf is given by 


a=rb=r—a т s А 
Е(ФЫ) = >, P3 dh. goa Pa Bh Pe 


Whence by (iv) 
а=" 7! e b-r-a 7 (r — а)! (рь b 
Elh = У c. .Eb єс (Фә) 


/ 
з лаф еш" en 4 


Ө) 2.0 


In (v) above, we may write 


1—pa—Pr_ b 
Pe», and 1— fw ES 
d. Poo an Po Qoa ci a 


Since (r — a) = (b + c), the general term of the binomial (gy, + Poa)” ^ is 
(r—a)! > (r — a) (е) (ey 
Wa Pha da = ua We) 4) ° 
Thus the second factor on the right of (v) is the (r — a)-fold sample weighted mean value of p 
when the unit sample expectation of extracting an item of class B is Psae. It is therefore the 


ith zero moment of the distribution defined by successive terms of the expansion of (Joa + Poa) ".* 
We may write it therefore as y(b,). In particular, 


palba) = (r — а)рь 5 
Halba) = (r — a)bus Ф + (r — а)* Pi 
YP va Фа — Poa (Ф + 2rpys)a + Pia (a? + 7°). 
* In the symbolism of 11.01-11.04, used elsewhere in 12.03, the operation illustrated by (v) is equivalent to 
writing 
Ba s.o = Е(аФ) = Еа". Enab). 
The operation Ej,(5*) here signifies taking the mean of the ith power of b for a fixed value of a. Hence it is the 
ith moment of the (r — a) fold distribution for a residual universe in which the proportion of items of class B is 
wd... It is evidently immaterial which way we write 
E,[a^ . Eu (6)] = pa. ‹.о = El! - Ear(a”)]. 


ww 
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By substitution in (v) we thus obtain 
E(a*b?) = 72р}, + TPudws 2 a? . тара ^ — Pros + 27рьа) = Trapaga “ 


т=з 
+ Pin 2 атау Ве" 


= PPa + трыдьа - pala) — Ръ( а + 2rbys) - наба) + fis - (а). 
Alternatively we can express the general term of the binomial in the form 


ge catt Cua D) c reta n nena 


ale! 
Whence we may also write 
E(a*b?) = т?р + тра». Gor - Kalb) — Pav(Qav + 2rpay)us(P) + Pas (Б). 
Hence we have 
2E(a?b?) = (7р, + трь.Ф)ш(а) + (7р5, + TPavgoa)kta(b) — Рь( а + 2рьа)н(а) 
— Paslgan + 2rpa)us(b) + pis - pala) + Pis - a(b). 


In this expression 


Pa =; 4 =1—рь; ta cb. 
Since M, = rp, and М, = rp», we derive 
2E(a*b* e +M, e +M, «+ 2M, 
M. = Pe Tula) e Porra) — Pla) 
(Po + эм) Я 
CMS sal ям ag 0005 (vi) 


The corresponding terms of the expressions involving E(a%c*) and E(b*c*) are definable 
by inspection, and (i) is now reducible to an expression involving the 2nd, 3rd and 4th zero 
moments of the A-score, B-score and C-score distributions. We may collect terms involving 
moments of the A-score distribution as follows: 


?.+М d [26 рь+2М, M, M, 1 
[ М. + 2 ula) rM a rM} 0 еа tu rala). 
Since (f; +p.) = 1— pa = q, and М, + M, = (r — Ma) = rq, the above reduces to 


Tle — ple) + greca 


We now recall the expressions for the 2nd, 3rd and 4th zero moments of the A-score distribution 
whose definitive binomial is (9. + pa)” : 


pala) = трада + тра = Maga + Mi; 
pala) = трада + Зарад, — 2rpiqs + pS 
= Ma, + ae 2Mapage + Mi; 
pala) = rp.qa — 670248 + 7r*psq« — Mr*paga + бүрд + pa 
ada — ee + 7M;q, — 11Мр,4„ + 6Miq. + Ма. 


14 
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Whence the terms of (i) involving moments of the A-score distributions are 


Mise) = + 4 ЕЮ; И МУ CU 


— Qr +1) — (2r +1) H © 
"Мы. n _ [i +эм, 2.7). - o. (vii) 


8. +7 пр, +6м, +2 а) 


1 1 
Mi "E M, 


The terms involving j1(b), a(b), pa(b), us(c), us(c), and p(c) are derivable by inspection 
from the above, and jn reduces to 


м) = sa + rr alb) + e) 
Ө te) – Cub — Dae 
+ PE + an + meen tee . (9 
In (x) the sum of terms involving second moments is 

tla) + н + ta) | А 

= 3+1) СЕЛИ: p CEDI | CEDH 
таулу (r+ 2 = Ner is т 46) rr an — 0) | 
3 — 3r? + r(r 4 yz : x + =] : 5 = * ^ 5 me X) И 


The sum of terms involving third moments is 
— M М? 
QE D[s e qu, + M, +M) — Apa + p +) ++ TE 


—(92r 4- Ys Nm 741 — qa)? 71 — Ф)? + 741—4) (xii) EI 
T а 2» 


In this expression 
(1—99* , (1—9)* , (1—9* G "LC *) DE Led 
! 6-- (9. і per 4. 
ai 5 ain o) hU L0 1 
Whence (xii) reduces to 


1 [- 1 1) m 
N ed а 2r -- 1 8r? E а E 
аам (xiii) 
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The terms involving 4th moments reduce to 


| i: oi M м: мр М? 
Умыт +? (i-o осо 
10-67 = aere E (sr +e -+ x) (xiv) 
By substitution of (xi)-(xiv) in (x) we have 
iE 1.1 
мс) =8 1 e (o + (sv) 


Evidently, the expression on the right approaches the limit 8 in agreement with (ii) if r is 
very large. In the same way, we may show that 


(С) = 48 = f(f+2)(f+4) and (С, 2:384 = f (f + 2) (f +4) Cf - 6) 


on the same assumption. However, it is equally evident that the moments of the statistic 
under discussion do not closely agree with those of the exact Chi-Square distribution unless 
the size of the sample is in fact very large. The closeness of the approximation and the sign of 
error depend not only on r but on the expected class proportions. 

The exact definition of moments of higher order than p for the 3-class case introduces 
no new matter of principle. It will therefore suffice to cite the results, viz. : 


= 6), (087—3) 9 1 SF 1 


uC) = 48 = 22, ut 2м? (xvi) 
(6368r — 181237 + 12180) _ 2(340r? — 1109r + 862) ^ 1 

(Cs) = 384 = = Z М, 
L9r— 1/2 1 307 — 31)%=2 1 2 1 fe 
ос 1 ео 


It is easy, if also laborious, to recognise the common pattern for Ca», Cs, etc. Thus more 
generally for a system of n = ( f + 1) classes the moments approach those of the Chi-Square 
variate for f degrees of freedom, e.g. 


m+ In—2 ‘ari 


ШС.) = (n — 1)(n + 1) = : = 3B TONES En) 
ME ү у — Oe 29 eror ты 
QUELLO AL 3x (xix) 


The accompanying tables (1-3) illustrate the exactitude of (xv)-(xvii) for the 3-class 
ease, О being there the sample value of the Chi-Square statistic and f the frequency of a sample 
of specified structure. Thus the column totals for fO, fO*, fQ?, fQ* are the numerical values 
ОЁ ш, Ho fs, а. The reader may still ask: how close must be the correspondence between 
the moments of the statistic under consideration and those of the Chi-Square distribution of 
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15.02, if we are to use the latter legitimately as a fitting curve ? The question invites laborious 
and formidable computations. It admits of no complete answer to date, and is worthy of 
exploration with the aid of the newest electronic machines. 


TABLE | 
Three-Class Universe (p, = t, рь = & p. = ҮЧ) 
-(4-Mj*, B- муз (C — MX 


OS E M, M. 
(a) Unit Sample. 
Q so | fQ* | fo Jo' 
Cre ee Ca as || чш |а 
C 0-5 CA 
GZU, CEN 2 ela] a] 
(=>? CHP, (0-A 
yt op t-a йк. Hmm 
Totals | 2 | 3 | XM | oV 
АЕ) 
ТАВІЕ 2 
Three-Class Universe (ра = 3, b» = $, Pe = ҮЧ), 
(4—M)* ,(B-My , (C — M) 
9- M 5— 35 шн 
(b) 2-fold Sample. 
Sample Structure 
A B c f о Jo |fo | Јо Јо 
Nice БАИ 
pas у — $) 
2 | о [0 а eur. ep. GPs eae ay 81 
1 1 о | 2p. = Co C=) Gee i H Te н 
Н H $ 
1 [о | 1 | ж. = cB. c» lp + 15| & |y 
lé + { 
о [2 [0 я=+ | GPCR, Сора |a 
0 1 1 [2р = 18 (op. Co Co a ve | We | ds | saors 
о [о | 2] н-т CE OGP Coe os и Га е |] че 
EE: i i 
Toms | 2 | зд | 5да |en 
(OE EE 


bao 


ant 
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TABLE 3 
Three-Class Universe (ba = $, b» = $, Pe = ҮЧ) 


_(A=M,)* , (B м? , (C — M) 
ga м, Hs M, + M, 


(c) 3-fold Sample. 


103,823 4,879,081 
43,000 848,000 


wis | зз 


12,167 279,841 
35,930 385,800 
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CHAPTER 20 


SECOND THOUGHTS ON SIGNIFICANCE* 


20.00 STATISTICAL INFERENCE 


Mucus of the content of this volume deals with test procedure designed to assess the credentials 
of a unique null hypothesis, It would be unfitting to conclude it without reference to growing 
uneasiness with respect to the role of the unique null hypothesis in statistical reasoning. Indeed, 
it is a remarkable circumstance that our own generation has simultaneously experienced unpre- 
cedented eagerness to exploit new tests of significance and vigorous controversy on a wide front 
with respect to the credentials of statistical inference. On all sides we hear that statistical theory 
is the logic of the sciences ; but at least three divergent views about its rationale are current and 
have advocates of no mean intellectual stature. Meanwhile, it is not feasible to offer a definition 
of statistical inference acceptable to all mathematicians who concern themselves with the theory 
of probability or to all practical statisticians. Any such definition presupposes an answer to 
the age-old question : what is truth ? Any answer to the latter presupposes a personal credo 
embodying the relation of human knowledge to the external world. That of the writer is in the 
broadest sense of the term behaviourist. Accordingly, we shall here assume that (a) any recipes 
for arriving at truth (rules of inference) on the basis of inescapably imperfect acquaintance with the 
real world have as the end in view an unequivocal assertion coupled with an admission of liability 
to error; (b) what distinguishes the recipes we call statistical inference is that this admission 
—the uncertainty safeguard of the assertion—is numerically specifiable within an assumed frame- 
work of indefinitely protracted repetition. Thus the uncertainty safeguard is the probability 
of false statement. 

From a practical viewpoint, it is useful to distinguish sharply between two techniques 
of statistical inference, though we shall later seek for a formula embracing both : 


(a) test procedures, including the traditional null hypothesis significance tests, ostensibly 
devised to adjudicate on the merits of particular hypotheses ; 


(b) methods of estimation, the aim of which is to make legitimate statements about numerical 
characteristics of a universe or subuniverse on the basis of information supplied by a 
sample. 


Within the domain of test decisions, | it is essential to distinguish between different targets 
of statistical inference : 


(i) to decide whether to regard a particular hypothesis as true or false ; 
(ii) to limit the risk of rejecting it if it is indeed correct. 


*I am greatly indebted to Raymond Wrighton for many (to me) profitable discussions of issues raised in this 
chapter which incorporates the substance of joint papers (Hogben and Wrighton) on The Statistical Theory of 
"Therapeutic and Prophylactic Trials in the British Journal of Social Medicine (1952). 

T F. J. Anscombe (1951), Mind, Vol. 60, makes a three-fold distinction : 

“ It is worthwhile to distinguish different purposes one may have in accepting a hypothesis : (i) to base 
an administrative decision on, (ii) for further testing and confirmation, (iii) for acceptance into the corpus 
of scientific knowledge, to be relied on in future work. There are risks, variously assessable, in coming to 
decisions in all three cases. For example, in case (iii), if the hypothesis is later found to be seriously false a 
lot of effort in investigating other points may have been wasted. Just as with prior confidences, risks are rather 
vague in magnitude, but in a formal theory it would be tempting to postulate a complete numerical risk-function.'^ 
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Broadly speaking, this dichotomy tallies with a useful distinction between two types of 
statistical inference definable as follows : 

(i) unconditional, if the uncertainty safeguard specifies the unconditional probability of 
the falsity of the assertion itself ; 

(ii) conditional, if the uncertainty safeguard merely specifies the probability of rejecting the 

relevant hypothesis when it is true. 

In symbolic form we may express the unconditional probability of false assertion as 
P, = (1 — Pj), and the conditional probability of false assertion within the framework of a 
particular hypothesis A as Py, , = (1 — Ps. a). Thus an assertion of the form P, = x is an 
example of unconditional statistical inference. Besides these two forms of statement we may make 
one of the form Р,> х. Evidently the more exact assertion P, = 0-95 has no pragmatic priority 
over the less definite assertion P, 20-95; and we may prefer to regard a statement expressed 
in the form P, >x as an example of (i) if we deem (1 — x) to be an acceptable level of uncer- 
tainty. On the other hand, it serves no useful purpose to make an assertion of the form P, > 0:30 
if we regard апу figure above 5 per cent. as ап inacceptable level of uncertainty. Hence we 
shall have no practical interest in stating an inference of the form P, > x unless we should be 
content with the assertion P, = x. Otherwise any useful statement of statistical inference we 
may undertake conforms to (ii). 

First Aid for Inequalities. In what follows we shall make more use than heretofore of inequalities 
referred to briefly on p. 10 of Vol. I. In higher school and elementary college courses one deals 
mainly with equations. One has therefore little experience of the importance of, or opportunity to get 
familiar with, statements involving the ideograms < or > and < (not greater than) or > (not less than). 
The student of statistical theory should be thoroughly familiar with their use. Here follows a short 
dictionary of meanings which the reader may interpret or test by substituting whole numbers for literal 
symbols. 

(i) m 2 x 2 kork <x <m means: x lies in the range А to m inclusive. 
(i) m > x > Ё ог Ё < x <m means: х is greater than А and no greater than m. 

(iii) m > x > kor k < х < m means: x is less than m and not less than А. 


(iv) the two statements x > m and x < m constitute an exclusive binary classification of the range 
of values x may assume, as do also the two statements x > m and x < m. 


(v) any of the following statements constitute an exclusive three-fold split of the range in which 
x may lie: 
(а) х> Е; k>x>m; x<m 


() xk; k>x>m; x<m 
() х> А; k>x>m; <m 
(4) х>2 А; k>x>m; х <т 
(vi) Тһе following rules of sign reversal are important : 
k—b < k—a when ba 
k—b <k—a when b >a 


(vii) If we denote the probability that the score x is no greater than m by P(x < m) and probabilities 
referable to other statements about the interval in which x lies in accordance with the same pattern, 
certain important identities derive from the addition theorem in virtue of the above, e.g. 


P(x > т) + Р(х < т) = 1 
Р(х > т) > 1—90 if Р(х < т) <= 
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2001 STATISTICAL INSPECTION 


In the foregoing discussion we have made a provisionally clear-cut distinction between estimation 
and test decision ; but we shall later see that the views of a growing and influential school of 
theoretical statistics make it possible to formulate a definition of statistical inference which 
exhibits the procedure of test decisions as a limiting case of the procedure of estimation. A 
new orientation, of which the theory is due to J. Neyman, E. S. Pearson and A. Wald, 
registers the impact on statistical theory of practices and metaphors which have developed over 
a long period under a shroud of trade secrecy within the research laboratories of large cor- 
porations, more especially the Bell Telephone Company. Much that is otherwise mysterious 
and highly abstract comes to life against the background of industrial practice. We shall 
therefore be better able to appreciate a fresh approach to the problem of significance, if we 
acquaint ourselves with some elements of the technique of statistical inspection (quality control) 
in commerce or industry. То do so some new terms will be necessary. On that account we 
must now digress. 

At the most elementary (p-chart) level the aim of statistical inspection is to ensure that the 
production process is working to schedule. The assumption is that no machine is perfect in the 
sense that the output is of uniform excellence. All we can hope for is that it continues to deliver 
samples of products with a fixed and satisfactory mean value in accordance with a known law 
of error, e.g. normal or binomial. The scoring system may be representative (e.g. duration 
of life of an electric light bulb) or taxonomic (e.g. percentage of inactive ampoules). If the 
sample score lies outside a range deemed satisfactory (e.g. Зо level), the inspection system 
recommends to the management overhaul of the machinery to ascertain whether the result is 
a fluke. Otherwise we may speak of the process as being in statistical equilibrium (Fig. 127). 


THE UNIVERSE 

‘of daily output (Consignment) 

ie THE PRODUCTION PROCESS 
im STATISTICAL EQUILIBRIUM 
ot Acceptable Quality Level 


Fic. 127. Sampling in the Stratified Universe of a Production Process in statistical equilibrium. 


In what follows we assume that this is so. The mean daily output will then be up to standard. 
That some consignments will be below it (Fig. 128) is then fully consistent with the possibility 
that the process is working as well as may be. 

Thus the manufacturer or seller can at most guarantee that the product will very rarely 
fall short of a standard of precision called the acceptable quality level (a.q.l.), e.g. that the sectional 
area of two by two inch wooden battens will not be less than 3-9 sq. in. or that the proportion of 
inert ampoules of post-pituitary extract in a consignment will not exceed one per cent. Complete 
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THE UNIVERSE OF DAILY OUTPUT 


Sample Distributions for subuniverses of Fig. 127. 


Fic. 128, 


14* 
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inspection to maintain this standard would be costly if practicable. Often it is impracticable, 
because testing the product (e.g. mean duration of life of an electric light bulb or activity of a 
glandular extract) involves destroying it. What we call quality control is therefore a sampling 
procedure. Evidently, a sample from a consignment above a.q.l. might be below it. Thus 
a 500-fold sample at random from a consignment of ampoules of which only 0-9 per cent. are 
defective might well contain 6 defectives (1:2 per cent). To reject every consignment as 
below the 1 per cent. guaranteed a.q.l. if the sample contained more than 1 per cent. defectives 


Consignment above 


ACCEPTABLE QUALITY LEVEL 
25% detectives 


Bl 2o 
Acceptable 
Consignment 


20 25 375 so 


INTOLERANCE LEVEL 
50X detectives 


[| ЖҮРҮ? 


Intolerable 
Consignment 


100 fold samples 
Rejection criterion — 3:238 
Acceptonce criterion 2с 37 


Fic. 129. "The risk of rejecting a consignment above Acceptable Quality Level is less than the risk of rejecting a 
consignment at a.q.l. and the risk of accepting a consignment below Intolerance Level is less than the risk of 
accepting it at i.l. 
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would therefore be wasteful. So one aim of quality control is to ensure that the producer will 
rarely discard a consignment, if it is at or above a.q.l. 

Given the law of distribution, e.g. a normally distributed sample mean or a binomial dis- 
tribution of proportionate defectives, the producer or seller may decide to reject consignments 
on the basis of sample structure in such a way as to exclude in the long run only « per cent. 
(e.g. 5 per cent.) of those at exactly a.q.l. We call this the producer's risk. This procedure, 
which ensures a risk less than « per cent. of rejecting consignments above a.q.l., is consistent 
with endorsing some consignments which do not in fact satisfy the a.q.l. guaranteed to the 
consumer. To safeguard the confidence of the latter, the seller or producer must ensure a low 
risk of releasing consignments too defective to be tolerable. This presupposes some standard 
we shall here call the level of intolerance (i.1.) and a criterion of acceptance comparable with the 
criterion of rejection, i.e. acceptance on condition that the risk of release at i.l. is only B per 
cent. (e.g. 5 per cent.). We call this consumer's risk.* The risk of rejecting a consignment 

a.q.l. is less than producer’s risk as already defined, ie. risk of rejection at a.q.l. 
The risk of accepting a consignment below i.l. is likewise less than the so-called consumer's 
risk, i.e. risk of rejecting at 1.1. (Fig. 129). 

'To give a more precise meaning to these terms it is essential to be clear that they refer 
in this context to opposite tails of a sample distribution. Accordingly, we must first recall 
(Vol. I, Chapter 5) the distinction between vector and modular assessment of risk. ‘Thus the 
modular risk that a sample value of a normally distributed variate will deviate from the true 
mean by more than + 1-9бе is 5 per cent. ; but the 5 per cent. level is at — 1:64c for the risk 
that a score will fall short of the mean and at + 1-640 for the risk that it will exceed the mean 
by so much. А fictitious example will clarify the issue. We shall suppose that : 


(a) the producer sets his level of acceptability for a consignment of battens at a mean figure 
М, = 20 mm. in thickness and the level of intolerance at a mean figure M, = 18 mm. 
in thickness ; 

(b) under ascertained working conditions of the sawmill the standard error of a 100-fold 
sample mean is 0-75 mm. with an approximately normal distribution. 


If inspection shows that the sample mean of a 100-fold sample of a particular load is 
x = 18:75, the equivalent standard scores will be : 


(a) if from a consignment at a.q.l. 


1875 — 20 
түл ашды 
(b) if from a consignment at i.l. 
18:75 — 18 — 1 
0-75 д 


"The decision to accept only samples above 1875 would thus involve а producer's risk at the 
1:66c level and a consumer's risk at the lo level. From the table of the normal we find 
that the area up to — 1:666 is 0-049 (nearly 5 per cent.) and the area beyond -+ c is 0-159 (nearly 
16 percent). If the true mean were above the a.q.l. the corresponding standard score would 
be numerically greater than — 1-66 and of the same sign. If below 1.1. it would be numerically 
greater than + 1 and of the same sign. If our criterion of acceptability is 18-75 for the 100-fold 


* The expression consumer's risk has a taint of uplift and is somewhat misleading on that account. It suggests 
that the primary end in view is to look after the interests of the consumer. It is more precise to regard the end 
in view as that of limiting the producer's risk of losing the consumer's goodwill. 
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sample mean, the risk of rejecting a consignment at or above a.q.l. is thus less than 5 per cent. 
and the risk of accepting a consignment at or below 1.1. is 16 per cent. or less. 

Suppose now that we equalise the two risks, i.e. choose a score criterion (x) which makes 
the two standard scores numerically equal with opposite signs, so that 


х—18 20—x 
075 075” 


Thus x = 19. In this event, the numerical value of the standard score is 1:3 and the table of 
the normal integral gives the area of the excluded tails as 0-092 or about 9 per cent. risk for 
both consumer and producer. By making the size (у) of sample larger we can, of course, make 
the variance of the sample mean smaller and the standard score itself larger. The s.d. of the 
two distributions will be in the ratio 7+: 100-4. In any case, the two risks will be equal if 
x = 19. If we want to keep the two risks at 5 per cent. or 1-640 level we therefore have : 

Vr 20-19 _ 64. — (18— 19) vr 

10° 075 075  '10 

«ræ 151, 


As an alternative illustration we may (again fictitiously) suppose that the pharmacist sets 
an a.q.l. for the proportion of below-standard ampoules of a preparation at 25 per cent. and 
an intolerance level of 50 per cent. For small samples (under 50) the normal approximation 
will be poor and for even larger samples the half interval correction (p. 116) will make a big 
difference to our assessment of per cent. risk. For illustrative purposes, we may therefore 
content ourselves with defining the risk in terms of the critical ratio (A). First suppose that 
r = 27 (Fig. 130). We shall denote by x the number of defectives in the 27-fold sample and 
define x, so that we : (a) reject a consignment if x > х,; (b) accept a consignment if x < x,. 
We now express x, in terms of the true mean and the sample s.d. If, = }(a.q.1. 25 per cent.) : 


hv(81) _ 27 + 9h 
E 


xe = thy thV pu, = 23 + 
If pa = 3 (i.l. 50 per cent.), we have likewise : 


27 hv?27 27 —3hv3 
us mE MEC 


Whence we have 
27 +9h 54 — 6h/3 
XU x 4 
In this case / is numerically a little less than 1-4 and x,~9'8, i.e. we should reject consignments 
if the 27-fold sample contained 10 or more defectives and accept them if they contained 9 or less. 
Now we may wish to make our risk smaller, let us say at 2c level. If so, we reject when 


ILLAE ie. x = 12 or over. 


We should accept if 
x<42—3V3 ie x—8orless. 


This would leave us with consignments about which we could make no decision to cover both 
risks on equal terms (at the 2c level), i.e. if the 27-fold sample yields 9, 10 or 11 defectives. We 
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INCOMPLETE INSPECTION PLAN TO SAFEGUARD PRODUCERS RISK AND CONSUMERS RISK 


B. Distribution of Detectives in о 27-1010 
+зотре if from a consignment ot 50% 
Intolerance Level (ps2) 


A. Distribution of Defectives in o 
27-fold sample if from о consign— 
ment ot 75% Acceptoble Quality 

Level (р= 4) 


Fic. 130. Sampling on the basis of an incompletely decisive rejection-acceptance criterion. Here p is the proportion 
of defectives. The values p = 0-25 (75 per cent. up to standard) and p = 0-50 (only 50 per cent. 
up to standard) respectively define a.q.l. and i.l. 


could, of course, retest by taking another 27-fold sample ; but the outcome might also be incon- 
clusive. So it is more economical to cut our cloth to the standard set by deciding in advance 
what size (r) of sample will make Л = 2 (or other prescribed risk criterion) when 


тр, + hoy = x, = rp, — hoy. 
When A = 2 we find that r œ 56, in which case we should reject consignments if the 56-fold 
sample yielded 21 or more defectives, and pass them if it yielded 20 or less. 
At this point, it is important to realise that we cannot have the best of both worlds by adding 


the result obtained from a first and inconclusive trial based on a 27-fold sample to that of a 
second sample of 29 in order to make up a 56-fold trial which must give a conclusive result. 
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"This procedure signifies that we do not give a subsequent 29-fold sample the opportunity to 
pair off with a 27-fold sample unless the latter contains 9-11 defectives. Thus only 3 out of 
28 classes of 27-fold sample would go to the making of the sample of 56; and we can make up 
a sample of 56 in accordance with the assumption of random choice by adding samples of 27 
and 29 only if every possible sample of 27 has an equal chance of association with every possible 
sample of 29. This raises the question : is it necessary to prescribe in advance a sample large 
enough to ensure a conclusive result? In other words, can we devise an admissible inspec- 
tion scheme which we can terminate so soon as the result is decisive ? We shall return to this 
issue at a later stage. 

Here it will be well to emphasise that the foregoing outline of the inspection problem 
is highly simplified for expository use in connexion with the main theme of this chapter. We 
have used highly fictitious examples for arithmetical simplicity. We have assumed: (a) as 
will usually be true, the critical score x, is not an integer, so that all scores obtainable lie on 
one side of it or the other ; (b) since the sample is a small fraction of a large consignment, we 
can dispense with the replacement condition ; (c) we know the true variance of the sample 
distribution when we score by the representative method and have good enough reason for 
regarding the normal approximation as adequate. Actually, a normal approximation will not 
be a good one when the method of scoring is taxonomic, as in the last example. Commonly, 
the admissible proportion of defectives will be very much smaller than 0-25 or 0-5 and a Poisson 
distribution might then give us a better picture of what we are doing. 

Within the same framework of limitations let us now look at our last illustration from a 
different point of view. We have chosen to adopt as our criterion of rejection for the 56-fold 
sample x > 22 and as our criterion of acceptance x < 21. This ensures a risk of approximately 
5 per cent. that we shall reject consignments at a.q.l. (р = 0:25) and an equivalent risk that 
we shall accept consignments at i.l. (р = 0:5), i.e. we shall accept 95 per cent. ог more con- 
signments if at or above a.q.l and reject 95 per cent. or more if at or below il. It goes 
without saying that the quality of some consignments will neither be up to a.q.l. or as low as 
il For instance, the true proportion of defectives in the consignment might be 0-38, in which 
event the 56-fold sample mean would lie between 21 and 22. Our rejection-acceptance criterion 
would then ensure about 50 per cent. risk of rejecting and the same risk of accepting such a 
consignment. 

We speak of the inspection plan as complete if it always leads to a decision at both a pre- 
scribed producer's risk (x) and a prescribed consumer's risk (В). We then have a model of what 
Wald calls a decision, in contradistinction to a significance, test. Formally we may describe the 
plan in terms of a rule to reject one or other alternative hypothesis : hypothesis 4 that the con- 
signment is at or above acceptable quality level, i.e. M > M, ; hypothesis В that the consignment 
is at or below intolerance level, i.e. M < M,. The test, i.e. the inspection plan itself, is the гше: 
reject the consignment only if the sample score x < х. In effect, we therefore say: reject 
hypothesis A if x < x, and reject hypothesis B if x > x, Our decision is verbally equivalent 
either to denying that the consignment is up to a.q.l. or to denying that the consignment is at or 
below il. Neither decision implies the denial of the possibility that the consignment mean (M) 
lies between the two levels (M, — M — M,). 

We chose x, so that х is the probability of rejecting the consignment at a.q.l. (M = M,) 
and f is that of accepting one at i.l. (М = М,). Since the probability of rejecting a consignment 
above a.q.l. will be less than х, and that of accepting one below i.l. will be less than B, we may 
say that the risk of rejecting hypothesis А (М < M,) when it is true is Р,. , < «and the risk 
of rejecting hypothesis B (M < M,) when it is true is P; , , < B. To choose x, our rejection 
score criterion, so that the risks х and В are themselves acceptable (e.g. о = 0-05 = В) we must 
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prescribe the size of the sample in advance. Our inspection plan which guarantees a decision to 
act in one way or the other is thus a test which guarantees minimum risk of wrongly rejecting 
one or other prescribed hypothesis, if we consistently follow the same rejection rule for samples of 
the same size. How such a prescription of test procedure differs from that of Yule and of Fisher 
will be the theme of comment at a later stage. 


20.00 Bayes’ THEOREM AND THE SEQUENTIAL RATIO 


In Chapter 5 of Vol. I we have exhibited a much-discussed theorem of unconditional statistical 
inference, that of Thomas Bayes (1763), as a balance sheet which sets out what information 
we require in order to specify the long-run frequencies with which we shall arbitrate correctly on 
the assumption that one or other of an exhaustive set of hypotheses is correct. We conceive each 
hypothesis as the assertion that a sample of specified composition comes from a sub-universe 
also of specified composition, leaving open the possibility that the composition of different sub- 
universes may be identical. Thus the sub-universes may be urns containing coloured balls. 
We shall then speak of them as urns of the same type if they contain balls of the same colour 
in the same proportions. This definition suffices if we sample with replacement. If we sample 
without replacement, we must make the additional assumption that urns of the same type contain 
the same total number of balls. The most general specification of the sample taken from one 
or other urn will, of course, be the term of a multinomial expansion ; but it will here suffice 
to specify the sample on the assumption that each sub-universe is of the 2-class kind, as when 
we distinguish balls by colour as red and other. For simplicity, we shall also assume (unless 
otherwise stated) that sampling is with replacement. 

As an example of the stratified universe of Bayes we may envisage a set of 10 urns constituted 
as follows : 


No. of Urns Proportion of Red balls 
Tyel . : ` Р ` 3 $ 
Type II . 5 Я а E 5 i 
Type Ш . E . " E 2 i 


Of this set-up we may initially define 3 parameters (Р, = 12, P» = x's, Ps = ү) respectively 
specifying the proportionate frequency with which we take a sample at random from any one 
type of urn; but the frequency with which samples of a particular composition will occur in 
any one of the three classes of samples so specified will depend on the parameters (ру = фр = +, 
ps = 3) which specify the proportion of red balls in the urn definitive of the class. Within 
the framework of the illustrative (but not necessary) assumption that we sample with replacement, 
the long run proportionate frequencies with which x red balls will occur respectively in an 
r-fold sample from one or other type of urn are : 
2 1 3° 
Poa Totg Ра = па +973 P.a Ta gr 


Within the framework of the 2-class universe and a 2-stage sampling process, Bayes' 
"Theorem is an exact answer to the question: what is the probability of correctly asserting that 
an r-fold sample comes from a sub-universe of type M if it contains x items of a class A (e.g. 
of red colour in this example)? If we speak of such an assertion as the adoption of hypothesis 
M, we may also phrase the issue as: what is the long-run proportionate frequency of correct 
action based on the assumption that hypothesis M is true? The answer follows from the 
product and addition rules, as we shall see below. 
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It is more easy to appreciate its rationale, if we first set out the result numerically as a balance 
sheet of long-run frequencies. Let us assume that r = 4 and x = 2, i.e. that our sample consists 
of 4 balls of which 2 are red, so that 


Pi = 273 Р..=#; Р, = es. 


Proportion of all 4-fold Samples 


With 2 red balls Other | Total 
From Typ] . . Yo = Tis To. H =з yo 
From Type II . . tga -=i + 
From Туре . . ios = He вн = 323 t 
| Та EXE II LE We + ve + db = HAR 1 


If we now abstract from this table the items which refer to samples with the structure specified 
we derive the following proportion of 4-fold samples with 2 red balls : 


We may set out the universe of sampling in more general terms as in Table 1 and the universe 
of samples as in Table 2. Table 3 then shows the balance sheet of long-run frequencies in the 
same terms as above. For a formal statement of the theorem we may employ the following 
symbols : 


Pn = (1 — qn) = proportionate frequency of a successful draw in a unit trial from sub- 
universe H. 
P, = proportionate frequency that an r-fold sample comes from sub-universe H. 


P, . » = conditional proportionate frequency that x is the score (successes) in the r-fold sample 
if it comes from sub-universe H, so that 


with replacement : Pan = rA S 
without replacement (from sub- 
universe of z items) : Pz. = Mx (np) "(ng)" = п. 


Ph» = proportionate frequency of the combined event that x is the sample score and that the 
sample comes from sub-universe H. 


Then by the product rule: 
Py, = Py. Prony 


P, = proportionate frequency of the event that the score of any r-fold sample is x. 
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Then by the addition rule: 


h= i= o 
Р, = x Р, = > P, Pea, 
LES hal 


P,.,- proportionate frequency of the conditional event that the r-fold sample comes from 
sub-universe H if x is the sample score. 


Then by the product rule: 


Py = Р,.Р,... 
Whence we obtain the theorem : 
P, DE. : 
Hilo Se я A E Я = a) 
DENS Rp p 
к= 
TABLE 1 
A Bayes’ Model of a Stratified Universe of Sampling 
Types of Urn I п "Total 
Nos. of each type m | Ny N 
Proportionate contribution E | Em i 
ditto to all samples LAS | Bor N 
Бонке of red balls in ^3 | » d 
Frequency of rfold sample ар. р P. aom ribi b 7* |Para] Р, 


TABLE 2 
The Bayes’ Model for r-fold samples 
Е With more or less 
From Urn With x red balls sore i "Total 
I Py. Pani Pl — Pz.) P, 
п Py. Pues РАІ — P.) Р, 
| 
ш РР Р1—Р,.;) P, 
h=3 
Total р IPIE lp. 1 
A-1 


* If sampling is without replacement we write for an urn containing tm balls of which sm are red 


MEE 
Lm = rias (Um — Sm ^ 
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TABLE 3 
Proportionate Frequency of the event that the r-fold sample contains x red balls 


Urn Comes from | Does not come from тош | 
1 тере Ary | IP 1 
п E | 1-Р,.. 1 
ш „ә | 1—P,.. 1 | 
Total 1 | 1 1 


In Table З Р,. „ is the proportionate frequency of the event that an z-fold sample with 
Score x comes from an urn of type H, i.e. the long-run frequency, among all samples so constituted, 
of those which come from such an urn. To assert that an 7-fold sample does so on the basis 
of the additional information that the sample score is x, is to assert that hypothesis H is true ; 
and P,., is the proportion of such assertions which correctly describe what happens in the 
longrun. 'Thus we may re-interpret (Table 4) the items of Table 3 as probabilities of the truth 
or falsehood of the assertion that a particular hypothesis is correct. Any items of the form 
(1 — Р, =) in the column headed False thus correspond to what we have called in 20.00 the 
uncertainty safeguard of the unconditional assertion that hypothesis H is true. 


TABLE 4 
Long-run frequency of Statements about the r-fold sample containing x red balls 


From Urn True False Total 
1 р... рез iB. 1 
п Pram рел 1-Р,.. 1 
ш Py., = 72 1-Р,.. 1 


Before proceeding further it may be helpful to some readers if we first pause to dispose 
of a common difficulty. The logic of Bayes’ theorem is not obscure or subtle against the back- 
ground of an urn model ; but appreciation of the relevance of the model to statistical inference 
in the domain of the world’s work makes no mean demands upon the imagination.* A biological 
illustration may assist the reader who boggles at this step. We shall suppose that a culture 
of fruit flies contains 100 females of which 5 carry a sex-linked lethal gene. Concerning one 
of these flies we know that 2 of its progeny are female. Now this will occasionally happen 
if it is normal, but much less rarely if it carries a sex-linked lethal gene. If we merely know 


* To add to the difficulties of the plain man, current and authoritative works repeat such paradoxical definitions 
as that the prior probability of the hypothesis is the probability assigned thereby to the “event before it has 
happened". Actually, our prior and posterior probabilities refer to different events, one to the probability that 
any r-fold sample comes from a sub-universe of type H and one to the probability that a particular sub-class of 
such samples (i.e. those with score x in our model set-up) comes from it. 
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that an individual is a female we know that there is a 95 per cent. chance that she is normal. 
This is the prior probability of the null hypothesis that the female is normal. ‘The null hypothesis 
assigns as the probability that any single offspring of a normal fly will be female pa = 1. The 
alternative hypothesis that she carries a sex-linked lethal gene assigns as the probability that any 
single offspring will be female p, = $. If our illustrative mother fly has 100 offspring of which 
three-fifths (i.e. 60) are female, the frequencies of correct judgments based on the assumption 
of normality or otherwise will be in the ratio 


95 10012-10 5 100! 280 
100° 60140! '100'60!40! 319% 


This is approximately 6-75: 1 in favour of the null hypothesis. If we estimate the relative 
frequencies of correct decisions on the false assumption that there are just as many female flies 
of both sorts in the culture, we should obtain the figure 0-36 : 1 or about 3: 1 against the null 
hypothesis. Such an assumption, known as Bayes' postulate, is on all fours with a common mis- 
conception implicit in the lay-out of age-case distributions in extant medical textbooks. Peptic 
ulcer is a much more common complaint after 40 than before that age ; but it would be a fallacy 
to assert that a conscript is over 40 because he has peptic ulcer. The proportion of conscripts 
over forty is very much less than that of younger men. Hence the actual number of younger men 
with peptic ulcer may well be greater than the actual number of men over 40 years of age. If 
so, there are more conscripts with peptic ulcer of whom one can correctly assert that they are 
not yet 40 years old. 

In short, Bayes’ postulate is the vulgar error of neglecting the population at risk. The 
true prior probabilities which it gratuitously equalises are in this context the age-standard- 
ising weights which make the balance sheet of risk a true bill Though we may not 
be able to attach an exact figure to them, we may be able to set some agreed limit on their 
relative values. In any case, the circumstance that we cannot do so with assurance constitutes 
no justification for assuming equality. The fact is that one undertakes an experiment to test 
a hypothesis either because one has good reason to believe in its truth or because one has good 
reason to suspect its falsity.* Good investigators do not commonly undertake experiments 
unless they have one or other end in view, i.e. unless there is factual basis for the belief that 
the prior probabilities are unequal. 

Much misunderstanding arises through speaking of the prior probability of a hypothesis 
when we cannot indeed distinguish between a hypothesis which specifies a parameter definitive 
of an existent population at risk and a hypothesis which specifies a parameter definitive of one 
which conceivably might exist. To be sure we can say that its prior probability is zero if the 
population specified by it is non-existent ; but the distinction, if formally trivial in this sense, 
is useful in another. Sometimes, as in the Model I situation of 20.06 below, we may postulate 
a sampling process which involves only one level of choice. By definition, we may then assign 
unity as prior probability to the correct hypothesis and zero as that of any conceptual alternative. 
In the general model situation—Model II of 20.08—to which Bayes’ balance sheet is relevant 
we conceive a 2-stage sampling process, the first being the choice of the urn or of the individual 
fruitfly in our previous examples. The impossibility of assigning in most real situations appro- 
priate numerical values to the prior probabilities is thus only one horn of the dilemma with 


* F. J. Anscombe (1951), Mind, Vol. 60, rightly comments as follows : 


“ As soon as any proposition or hypothesis has been formulated which is worth testing experimentally, 
there is already evidence as to its truth derived from existing accepted knowledge and from considerations 
of analogy or ' consilience’. A question to which we have no grounds whatever for hazarding an answer is 
an idle question and would not be the subject of scientific investigation.” 
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which Bayes' theorem confronts us. "The other is that it is often difficult to decide which model 
is appropriate to the real situation. Remarkable recent advances іп the theory of test procedure 
and of estimation dealt with below have come about by formulating decision criteria in the 
derivation of which the prior probabilities cancel out. Neither our ignorance of their true values 
nor of their effective relevance then prevents us from assigning a firm uncertainty safeguard 
to an unconditional assertion. 
TABLE 5 
Relative Truth Table 
(Bayes’ Model of Tables 1-4) 


Urns Relative Truth Ratio 
Р... Bepd-pr 


Р,.. Ps. P3 — Ра) 


Ps.e_ Ps. Pil — р) 
Р... Pp — pa) 


npn Ва = pol PB. = py 
m | в Рох РВ рт" 


1I and Ш | В» = 


Table 5 embodies the information of Table 4 in a different but sufficiently explicit way. We 
may speak of the fractions designated Bj; etc., in our relative truth table as the Bayes’ ratio 
for alternative hypotheses І and II, еіс. Now we can dissect Bj», etc., into two components 


if we write 
Pie _ Pi(l Р) fe 
ug ee E JM 


In more general terms we may then write for r-fold samples containing x red balls 
By.—h;.Sg.. . : ` 7 $ . (ü) 


The expressions in the numerator and denominator of (iii) have a special meaning which permits 
us to interpret Bayes’ ratio in a new way. Whereas Р„.„ etc. defined above is the probability 
assigned by a particular hypothesis (4) to a sample specified by the score x, the expression 
pi(1 — 5.) * has a more restricted meaning which is clear if we consider the possible ways 
in which we can score 2 heads and 2 tails in a 4-fold toss of an unbiased penny, viz. : 


H H-T TT Hee 
НОВО TH- FEH 
HT TA TH HOL 


The probability of each such sequence consistent with the 4-fold sample score x = 2 is (3)*, 
and the term 7,,, = 6 in the expression for the probability that the sample score is in fact 2, 
viz. : 6(4)4, specifies the number of different permutations of 4 items, 2 alike of one sort and 2 
alike of the other. In short, the ratio S; of (ii) above is the ratio of the probabilities assigned 
by 2 hypotheses to the occurrence of a particular score sequence. On this account we may speak 
of it as a Sequential Ratio. 

"Тһе fact last stated gives the sequential ratio a special interest vis-d-vis the problem of 
economical inspection as stated above (p. 842). At each successive unit trial, it assumes a new 
value which cannot oscillate outside fixed boundaries and must approach more and more closely 
to a fixed limit. To see this property in action let us consider a numerical example. We 
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Postulate : (i) two types of urn, A containing red and black balls in the ratio 1 : 1 and B containing 
red and black balls in the ratio 2:1; (ii) sampling with replacement, the score x being the 
number of red balls in the r-fold sample. Thus our hypotheses are 
Hypothesis A а=} 
Hypothesis В рь = $. 
= Фаг > 
nad угоне 
From (ii) we can proceed to tabulate results of score sequences involving different total 
scores in an 8-fold sample as below : 


Whence we have 


(iv) 


Score (x) Sequential Ratio (S) Score (x) Sequential Ratio (S) 
0 5 $382 = 0:801 
1 6 qM = 0-400 
2 7 ASA. = 0-200 
3 8 JAM. = 0100 
4 


From inspection of the above we see that a critical score level x, = 4-5 divides all 8-fold 
samples into two sets. If x < Xe Sa». > 1, і.е. hypothesis A assigns a higher probability 
to the observed sequence than does hypothesis B. If x — x, S,,,4 < 1 and the converse 
istrue. Without making any claims which sidestep the Bayes' dilemma, we may choose to be 
content with: (i) accepting hypothesis A if it assigns a probability nine times as great as does 
hypothesis B to the observed sequence, ie. Sab, 79; (ii) accepting hypothesis В if the 
converse is true, ie. S,,,4 « 0-1. If so, we may define 3 score levels as follows : 


x15 content to accept A. 
15 <х<75 no decision 
x275 content to accept B. 


Let us now suppose that our x score is in fact 2at the Sth trial. If so, we suspend judgment. 
At the next (9th) trial the total score must be 2 or 3; and 


Saso = 3S, or 1S, 
19683 19683. 


?.9— 9048 or "3006 

On the assumption that we accept hypothesis A when Sa», 29 we shall thus reach a decision 
at the 9th trial if we then score a failure (extract a black ball) and suspend judgment if we then 
Score a success. At each trial we may in fact suspend judgment without bias to subsequent 
decision. 

If we now return to (iii) we can give a meaning to our test criterion in terms of Bayes' prior 
probabilities. ‘To say that we shall be more often right than wrong if we act on the assumption 
that hypothesis A is true than if we act on the assumption that the alternative hypothesis is 
true is equivalent to writing B,,., 1, whence 
1 D 1 


ha > or Fee 2 = E Б (v) 


SuSE 
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If we make our criterion of acceptance of hypothesis A that S,,., >9 as above, we there- 
fore mean that we should be right in accepting it more often than in accepting hypothesis B 
so long as the prior probability of the latter does not exceed 9 times that of the former. If 
we make our criterion for rejecting hypothesis A (accepting the alternative) that Sas., > 0-1 
we signify that we shall be more often right than wrong in doing so unless hypothesis A has a 
prior probability more than 9 times that of hypothesis B. 

The use of the sequential ratio so prescribed is different from other test procedures because 
it permits us to proceed to a decisive and unbiased verdict without prescribing in advance how 
large a sample will be necessary. "This, of course, presupposes a positive answer to the question : 
can we guarantee that the outcome will eventually be decisive if we make the sample size (r) 
sufficiently large ? 

Before we attempt to answer this question, it will be instructive to formulate more precisely 
a conclusion already stated: if S, and S,,, are sequential ratios for the rth and the (r + 1)th 
sample respectively, within what limits does S,,, lie? Let us write рь = mpa, whence 

s = pa) 


- S І „(к=®)` n : $ 3 (vi) 


Only two cases may arise when we enlarge the sample from r to r + 1 items: (i) x may remain 
fixed if the result of the further trial is a failure ; (ii) x may increase by unity if the result is a 
success. Thus we may put 


_1fi=p, ‘Wee oe n 
Sra = 3; тр, 90 aT — mp SS 0 
Thus we have 
Su dw eua. 1 E 
5, Б) = 3)“ = (viii) 
In particular, when pa = $ we have 
1 
S= E E 
1 1 
Sra п туп * m — my 
ie Sides ЕЧ 1 А 
Ета р [ ead 4 E ü E Е a (ix) 


Since р, <1, m < p3" in (v) and m «2 in (vi. When p, = 3 апар, = 1, m = $; and (ix) 
becomes 


== or - t E . . . (x) 


As stated, a sequential test would be of little value if we had no assurance that it would 
eventually terminate, i.e. that the sequential ratio will attain an upper limit 4 assigned as 
our criterion that hypothesis A is acceptable and a lower limit В assigned as our criterion that 


SECOND THOUGHTS ON SIGNIFICANCE 857 


hypothesis B is acceptable. For simplicity we may adopt the convention that m > 1 in (vi) 
et seq., i.e. Pa < py, and examine the consequences of the empirical rule of thumb commonly 
called the law of the constancy of great numbers, viz. that x approaches its expected mean value 
rp more closely as we make r larger. Thus we may say : 
(i) if hypothesis A is true, x eventually approaches indefinitely near the limit x = rp, ; 
(ii) if hypothesis B is true, x eventually approaches indefinitely near the limit 
х = TPs = mrp,. 


Let us therefore examine what values Sa, 5, respectively the sequential ratio takes when hypo- 
thesis 4 and hypothesis B are true, and r is very large in this sense. 
For the arithmetical example already cited pa= 4, and т = $, so that 


2 — т\“ 1 3” 

>= ez ‘Cony = 29" 
"The two limiting values of x are 1r and $7, so that 

з 9 i 3" 27 5 

E E 

22 3 
When r is indefinitely large S, itself approaches infinity and S, approaches zero. It will suffice 
to formalise this for a particular case of special interest, viz. pa = $, 1 > рь > Pa so that 
1<m<2. We then have 


2— mW 1 1 Р 
s (C) А Q—my On aF E 2 б (xi) 


t2 


m 
(2—m d 1.  (2—m9 Е 
Syc (2=") =) те ` 7 D (xii) 


Since m lies inside the limits 1 and 2, (2m — m?) in (xi) lies inside the limits 0 and 1, so 
that S, in (xi) is indefinitely large when 7 is also. The meaning of (xii) is more clear, if we 


write it as 
1/2— mor 
=)". 
Since m > 1, the first factor in the above becomes smaller and smaller when r becomes larger. 


That this is also true of the second factor is evident, if we write m = 1 + h in which h is positive 
and less than unity if pẹ < 1. Thus we have 
2—m -1—-h 1 
mo TAA <l. 
Evidently therefore S, approaches zero as its limiting value. 

If then the hypotheses р, = } and р, = іт constitute an exclusive and exhaustive set in 
the sense that one is true if the other is false and vice versa, the foregoing reasoning leads to 
the conclusion that the test will terminate in the rejection of the false and the acceptance of 
the true one if we make r sufficiently large. This does not imply that it will do so if a third 
hypothesis is admissible. 
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A single example will suffice to make this clear. Let us again suppose that we set out to 
test the alternative hypotheses р, = $ and р, = $. This time, however, we shall admit the 
possibility that p, = $ is the true value of the sub-universe parameter p, so that x tends to ёғ 
in the limit. Thus the limiting value of the sequential ratio will be 


з" (2435 
“a (956/ ° 


5 


t2 


'This ratio becomes smaller and smaller as r becomes larger. Hence the test will eventually 
lead wrongly to acceptance of the hypothesis p, = $ in preference to р, = 3. Alternatively, 
we may admit the possibility pa = $} as the true value of p. Whence we get the limiting 


sequential ratio as 
r 
320) 20 & 
Gm) c (1-63). 


This ratio becomes larger as r increases. Hence the test will eventually lead wrongly to the 
acceptance of the hypothesis р, = } in preference to p, = $ if the true value of p is 0-55. 

The exact boundary is definable in terms which the reader can generalise. For the par- 
ticular case when our sequential ratio is referable to the hypotheses р, = 3 and р, = $, we 
shall postulate a true value р, = $k so that x tends to the limit $kr and S to the limit 


fas 


3 9 
gm» = Se = ges] - 
The test will not terminate if S, = 1, i.e. if 2**? = 9, and 
log 9 = (k + 2) log 2, 


If we set pa = Ё and p, = $, the sequential ratio will diminish as r increases if p > 444 and 
increases as ғ increases if p < 447 as the two examples last cited show. The reader should not 
find it difficult to generalise this result, the implications of which are clear. The interpretation 
of the test procedure against the background of the Bayes’ ratio presupposes that each alternative 
hypothesis has a finite prior probability. If both hypotheses are wrong and both are inad- 
missible, the test will terminate in a wrong decision. This raises the question : can we formulate 
the sequential test procedure in terms of alternative hypotheses which cannot both be wrong ? 

We have already seen that we can interpret an inspection plan in terms of the alternative 
hypotheses p < р, and р > р. These do not constitute an exclusive set, since it is possible 
that pa < р < рь; but we can agree to confine the verdict of the test procedure to the denial of 
one or the other, i.e. to alternative statements to the effect p > р, or p < р Neither statement 
is then inconsistent with the possibility last stated. Thus a test procedure will result in denying 
one of the propositions р = 4 and p = $ if designed to ensure the negation of one or other of the 
hypotheses р < } and p > 3; but we have not as yet shown how it is possible to interpret 
sequential ratio limits unless the alternatives assume the exact form р = р, огр = р. This 
will be the theme of 20.05 below. The advantage of doing so, if possible, is that we can continue 
to sample until we have reached a decision without prescribing in advance what size of sample 
will necessarily ensure a conclusive outcome. 
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20.03 LIMITATIONS OF THE UNIQUE NULL HYPOTHESIS 


For the past generation research workers engaged on agricultural trials, tests of the efficacy 
of therapeutic or prophylactic measures, sociological field work and bioassay have relied for 
validification of their results on decision tests devised by R. A. Fisher and his co-workers in 
conformity with a familiar pattern. Such tests entail: (а) the invocation of a unique so-called 
null hypothesis which prescribes the frequency with which a sample score will lie outside a 
prescribed limit (or limits) ; (b) the specification of a criterion of rejection, i.e. the convention 
to reject the hypothesis if the sample score does in fact lie outside the prescribed limit(s). 
Customarily (and oddly) the corresponding limiting frequency adopted is at the 95 per cent. 
(approximately 20: 1 odds) level; and the possibility of defining it in such terms resides in 
the fact that the unique hypothesis chosen for the purpose has an assignable distribution function. 
With one notable exception the latter is specifiable, though rarely recognised as such, within 
the framework of the Type System of Karl Pearson.* 

From one viewpoint, the prevalence of the fashion referred to is comprehensible. The 
publication of Statistical Methods for Research Workers prepared the way for manuals by Snedecor, 
Tippett, Hagood, Quenouille and others, exhibiting schemata for computation in conformity 
with the Fisher test prescriptions. By recourse to a wealth of exemplary material the research 
worker willing to take the test prescription on trust can therefore readily, it may be all too readily, 
select a type specimen at least seemingly like his or her own problem. None the less, there 
must be among those who do so, not a few who have felt misgiving for any (or all) of several 
reasons, notably the following : 


(a) not infrequently the form of the null hypothesis is irrelevant to the main issue, e.g. 
as when the decision that two treatment procedures have different results is of trivial 
interest in comparison with the decision that treatment B is at least so much more effective 
than treatment А; 

(b) the type of decision which concerns the investigator determines the choice of a par- 
ticular null hypothesis far less than considerations of algebraic convenience vis-d-vis 
the specification of a sample distribution ; 

(c) the test prescriptions take no stock of any alternative hypothesis which may indeed 
be the main concern of the investigator. 


The first misgiving has special reference to the domain of estimation, and as such to the 
theory of confidence specially associated with the names of J. Neyman and E. S. Pearson. The 
second and third raise issues which a theory of test procedure also advanced by Neyman and 
Pearson has brought into focus ; but their critique of the unique null hypothesis has to date 
exerted little influence on research workers outside America. "This is less because their writings 
lack the polemic vitality of their predecessors than because the concepts invoked are logically 
subtle and on that account difficult to assimilate unless examined against a background of 
familiar material. The aim of what follows is to help the laboratory or the field research worker 
to recognise pitfalls in previously accepted test procedures and to materialise some of the essen- 
tially novel concepts of the Neyman-Pearson approach. 


* Thus Snedecor's variance ratio F-test described as a score transformation of Fisher's z-test is really a type VI, 
the Gosset t-test a type VII, the distribution of the sample variance a type III, including as a special case the 
current test for the 2 x 2 Table (1 d.f.) which is (as Fisher himself first pointed out) formally equivalent to the normal 
proportionate score difference test in the binomial domain, the significance test for the correlation ratio and for 
Spearman's rank correlation coefficient is a type II, and the best fitting curve for a non-replacement sampling 
distribution in the 2-class universe is a type I. Fisher's distribution of the product-moment index for non-zero 
covariance when regression is linear is the notable exception to the foregoing remarks. 
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One way to do so is to formulate a biological problem which involves no predilection for 
a single hypothesis as the null one in virtue of algebraic convenience as such. Accordingly, 
we shall again (p. 852) think of a culture of Drosophila containing normal females and females 
which carry a sex-linked lethal gene. With Bacon we shall concede that nature is more diverse in 
her operations than man in his conceptions, but our knowledge of laboratory conditions (pre- 
sumptively highly standardised) will justify the provisional assumption that any such female 
fruit-fly with an excessively large number of female offspring will, in fact, be either an entirely 
normal female or a lethal carrier. "That is to say, we exclude such a contingency as the possibility 
that there is an endemic rare virus disease more fatal to male than to female larvae. We may then 
with some justifiable assurance postulate two hypotheses about any female in the culture : 


Hypothesis 4: the female is normal, in which event the probability that any one of her 
offspring will be female is р, = 3. 


Hypothesis B: the female is a lethal carrier, whence the probability that any one of her 
offspring is female is p, = $. 


We shall now suppose that a particular female has 144 offspring, and examine the current 
theory of test procedure when the end in view is to decide whether we shall adopt one or other 
hypothesis. Our primary concern will thus be with what the test prescribes, and as such has 
no necessary connexion with whether it leads us to a correct decision. 

We first note that each hypothesis equally prescribes for 144-fold fraternities referable 
to a single fly mother the long-run frequency of such as respectively contain 0, 1, 2... 143, 
144 females. We may specify the relevant parameters thus 


Size of sample Probability that any Mean no. of females s.d. of score distribution 


(fraternity) single offspring is female in sample fraternity of the sample 
A 144 "DEI M, 72 2,6 
B 144 a=} M, =96 о, = 5:66 


From an algebraic viewpoint neither hypothesis specified above has anything to commend it 
as preferable to the alternative ; but we may lazily and arbitrarily agree to consider first of all 
the consequences of adopting 4 as the null hypothesis in the traditional sense, if only because 
laboratory and field workers would commonly do so in a comparable situation. Lazily and 
arbitrarily also, we shall first adopt a modular criterion of rejection for the same reason, i.e. 
we shall reject the hypothesis chosen unless the number of females x is such that 


| (© — M.) | < Xa 


In conformity likewise with current convention, we shall choose the score X, so that the pro- 
bability (x) that х will lie in the critical region, i.e. outside the range specified above is about 
0-05 if the null hypothesis correctly describes the situation. For samples of 144 and values of 
Pa (or py) anywhere (as in this example) within the range 0-1 to 0-9, the normal integral gives 
an adequate quadrature at the so-called 96 per cent. significance level, if we make the appropriate 
half interval correction. If we choose X, = + 12:5, so that (х — M,) = + X, when (x — Ma) 
œ + 2-08е the table of the normal integral sets х ~ 0-038. In effect, we now have made the 
decision to regard the female with 144 offspring as normal if the number of her female offspring 
lies in the range 60 to 84 inclusive and to reject her claims as such, i.e. in this context to regard her 
as a lethal carrier, if her female offspring number more than 84 or less than 60. 

In the last sentence we assume that the end in view of the test is to arrive at a decision, as do 
at least ninety-nine per cent. of laboratory workers who invoke it in communicating the results 
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A. Modular Criterion 


Reject the Null Hypothesis if: 


X«59, x285 
=т= 0-038, 82 0:021 


84.5 96 
1314 


B. Vector Criterion 


Reject the Null Hypothesis if: 
x85 
aœ 0-019, 82 0:021 


845 96 
1312 


Fic. 131. Testing а null hypothesis (pa = 0-5) against the background of a single admissible alternative 
hypothesis B (p = 06). 
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of their researches to the world atlarge. Fisher himself (vide Design of Experiments, fifth edition, 
1949, p. 16) says: ‘It should be noted that the null hypothesis is never proved or established 
but is possibly disproved in the course of experimentation.’ A doctrinaire exponent of the 
Yule-Fisher test procedure is therefore free to disclaim the intention stated in favour of an 
affirmative or positive answer in contradistinction to the alternative verdicts: (a) hypothesis 
false; (b) hypothesis unproven. If so, only one of two sorts of error we shall now distinguish 
is relevant to the outcome of the test ; but the evasion of the other forces us to a somewhat damag- 
ing admission mentioned at the end of 20-04 and more fully in 20-08, 

In the Neyman-Pearson theory of test procedure we speak of « as the conditional pro- 
bability of making an error of the first kind. Now the cited value of « ( œ 0:038) correctly 
assigns the probability of rejecting the null hypothesis only on the assumption that the latter 
is true, i.c. that the mother fly is normal. This we do not know, the aim of the test being to 
throw light on the alternative possibility. If we carry out the rule of the test consistently, 
we shall sometimes make an error of the first kind, i.e. reject normal flies as such and by the 
same token wrongly identify as carriers flies which are indeed normal. Conversely, we shall 
sometimes apply the test to flies which are indeed carriers. If the number of females among 
their progeny lies within the range 60-84 inclusive we shall reject them as such. We shall 
then wrongly accept the null hypothesis. This is the error of the second kind, which we make 
in this context if the relevant parameters of the appropriate distribution are р = $, M, = 96 
and оъ ~ 5:66. With due regard to the half interval correction, the region we then exclude 
is from 59:5 to 84-5 bounded by (x — M,) 36:5 and (x — M,) = — 115, i.e. (x — My) 
c — 6:00, and (x — M,) = — 2:030,. Since the area of the normal integral of unit variance 
from — оо up to — 6-4 is utterly trivial, we make no sensible error if we say that the consistent 
application of the rule leads us now to reject carriers as such with a probability (8) assigned 
by the area of the normal curve of unit variance in the range from — со to — 2-03. We speak 
of this loosely as the probability of making an error of the second kind ; and the table of the 
normal integral in this case cites the value В ~0-0212. More explicitly, B is the conditional 
probability of accepting the null hypothesis, if it is false ; but we have as yet said nothing about 
how often it will be false. 

In short, the only information we have at our disposal so far bears on the probability (2) 
of rejecting the null hypothesis when it is true, and that (8) of rejecting the alternative when the 
latter is true, i.e. of accepting the null hypothesis when it is false. If we now suppose that we 
actually know the proportion of normal and carrier females in the culture, we can take our 
analysis a decisive step forward. We shall assume that the culture consists of 500 mothers of 
which 450 are normal and 50 are carriers. If we then choose at random * any single fly with 
144 offspring as a test subject we may say that 

(i) P, — 0:9 is the probability that it will be normal, i.e. the probability that the null 

hypothesis is applicable to the test subject ; 

(ii) P, = 0-1 = (1 — P,) is the probability that it will be a carrier, i.e. that the alternative 

hypothesis is applicable to the test subject. 


We now have all the relevant data for a statistical specification of the long-run frequency 
of all 4 possible results of the outcome of the test : 


The fly is normal and we rightly accept it as such 
P,(1 — a) = (0:9) (0:962) = 0-866. 


* 'The effect of the lethal gene on the fertility of the fly introduces a bias for which we can allow, and one which 
we may therefore deliberately neglect for heuristic purposes. 
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The fly is normal and we wrongly reject it as such 
P, . а = (0-9) (0-038) = 0-034. 
The fly is a carrier and we rightly accept it as such 
(1 — Pa) (1 — B) = (0-1) (0:979) = 0-098. 
The fly is a carrier and we wrongly reject it as such 
(1 — Р,)В = (0-1) (0-021) = 0-002. 


To each assertion consistent application of the rule leads us to make we may thus assign 
a probability that it will be true or false. We may then set out a balance sheet as follows : 


Assertion true Assertion false 
Null hypothesis true P,(1 — а) = 0-866 Pa. œ = 0-034 
Null hypothesis false (1 — P4)1 — f) = 0-098 (1 — P,)p = 0-002 
Total | 1 — 8 — (x — B)P, = 0-964 В + (а — B)P, = 0-036 


In conformity with the definition given above, we may speak with propriety of the pro- 
bability (Pj) of making a correct decision and of the probability (P, ) of making a false one by 
consistent application of the rule, in which case our balance sheet yields 


Р,= 1 — В – («— В)Р, = 96-4 percent . А а + @ 
Р,= В + (х — В)Р, = 3:6 percent. . > .  . . (ii) 


For the reasons we shall come to later, the outcome of our choice of a rejection criterion 
is here vastly more encouraging than need be in most situations ; but we can do better. We 
have lazily adopted a modular criterion because laboratory and field workers commonly do so, 
regardless of the end in view, when the sample distribution prescribed by the null hypothesis 
is symmetrical. Now fraternities of 144 flies of which less than 60 are females will be vastly 
less common, if the mother is a carrier, than they would otherwise be. It would thus seem 
to be more reasonable to restrict our attention to families with an excessive number of females. 
We shall now therefore adopt a vector criterion, i.e. reject as abnormal only mothers with more 
than 84 female offspring, so that we exclude only one tail of the approximately normal dis- 
tribution and halve our error of the first kind, i.e. set x = 0-019. For reasons stated this does not 
materially affect the value of B since the chance that a carrier will have less than 60 females 
among 144 offspring is negligible. If we then say that we shall reject the null hypothesis at 
the vector level + 2-08c in contradistinction to the modular level + 2:080, we now put ж = 0-019 
but В = 0-021 as before. Whence our balance sheet summarised by (i) and (ii) becomes 


Р, = 0:981 = 98-1 per cent.; Р, = 0-019 = 1:9 per cent. 


That the adoption of the vector criterion does in fact give a better prognosis of correct 
decision is not surprising, and Fig. 131 sufficiently exhibits why this is so in the situation under 
discussion. Indeed the use of a modular criterion, though sanctioned by custom, is meaning- 
less in such a situation. 

At this stage we may also note with profit an interesting consequence of (i). If «= 8 
so that 1 — В = 1 — апа (x — B) = 0, equation (i) reduces to P, = (1 — a). Within the 
framework of our assumptions that there is only one admissible alternative to the null hypothesis, 
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TESTING ALTERNATIVE HYPOTHESES 


Mean(M) fs 
Hypothesis A 198 5 
Hypothesis B 362 E 
Probability 
CRITERION of ACCEPTANCE Error of First Kind ИШ <= 005 
for HYPOTHESIS A (чи Hypotese A when istra) 
Error of Second Кіпа, Mang = 005 
pl Hypothesis A when itis false) -9f 


((00-fold somple) 


| 
| 


ELI Mg362 


Fic. 132. Testing exclusive Alternative Hypotheses : (i) Rejection-Acceptance Criterion chosen to make 
error of first kind equal to error of second kind. 


so that Р, = (1 — Р), we can assign a value to the long run frequency of correct decision based 
on consistent application of the rule without any prior knowledge (P, or P,) of the population 
at risk if we define our rejection criterion in such a way as to equalise the probabilities of errors of 
the two kinds. We can then predetermine that the value of « may be as small as we care to make 
it by prescribing a sample size sufficiently large. Needless to say, this presupposes the possibility 
of defining the distribution function of the single admissible alternative hypothesis. 

Within the framework of assumptions and in the same model set-up, let us now explore 
the effects of making our criterion for rejecting the null hypothesis more exacting in the sense 
that our error of the first kind is less. Thus we shall decide to accept a female fly with 144 
offspring as normal if (vector criterion) she has 88 or less female offspring and deem her (rightly 
or wrongly) to be a lethal carrier if she has 89 or more. We then set the decision limits on 
either side of х = 885, in which event (x — Ma) = + 2-750, and (x — M,) = — 1:333e,. 
Whence from the table of the normal integral we derive x = 0-003 and В = 0-092. If we 
paint these values in (i) we get 

1— В = 0:908 and (х — B)P, = — 0-080, 

.. Р, = 0:988 ог 98:8 per cent. 
In this situation little advantage (98:8 as against 98:1 per cent.) accrues from making our criterion 
for rejection of the null hypothesis more exacting ; but we have chosen our null hypothesis 


as the hypothesis with greater prior probability since the culture contains a great excess of normal 
flies. Let us then reverse the situation by postulating that the culture contains 450 lethal 
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TESTING ALTERNATIVE HYPOTHESES 


MenM) О 
HypothesisA 198 E 
Hypothesis8 362 5 


Probability 

CRITERION of ACCEPTANCE Error of First Kind E «-oo 
A when it is true) 

for HYPOTHESIS A PUDE, ) 


хез?! О Rien it is fola) ШИШ 32-2 


Eu 


M362 


Fic. 133, Testing the same exclusive alternative hypotheses as in Fig. 132 and same sample size, choice of rejection- 
acceptance criterion which makes the error of the first kind smaller, makes the error of the second larger. 


carriers and 50 normal among 500 female flies in all, і.е. Р, = 0-1 and Р, = 0:9. In this case 
(x — B)P, = — 0:009, so that 


P, = 0:908 + 0-009 = 0:917 or 91-7 per cent. 


If the null hypothesis is referable to the smaller population at risk (i.e. if it has lower prior 
probability than the alternative) the effect of making the rejection criterion more exacting is to 
lower the probability of arriving at a correct decision. 

Before discussing how far this rule is of general application within the framework of our 
model assumptions, let us take stock of another highly relevant variable, viz. sample size. For 
a fixed size of sample the foregoing results have sufficiently emphasised what a visual diagram 
suffices to demonstrate (Figs. 132-134), i.e. we cannot decrease the conditional probability (а) 
of an error of the first kind without increasing the conditional probability (8) of an error of the 
second kind and vice versa. It is also of importance to appreciate that we can make В for a 
preassigned value of « as small as we wish to make it, only if we make the size of the sample 
large enough. Conversely, we can keep « at a preassigned level for a smaller test sample 
only by making £ larger. 

Consider for example the consequence of applying the foregoing test to fraternities of 100, 
so that M, —50; e, —5; М, = 666 and о, — 471. If we make the vector criterion of 
acceptance or rejection conveniently near the 2c level, we shall set it on either side of a score 
level 60-5 in which event (x — M,) is approximately 2-10, and о = 0:036. If so, (x — М) 
is approximately — 1:320, апа В ~0-0934. The value of ж here agrees as closely as need 
be for exemplary purposes with the value chosen (x — 0-038) for the 144-fold sample when 
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TESTING ALTERNATIVE HYPOTHESES 
Meon(M) n 

Hypothesis A юв 5 

HypothesisB 362 5 


Probobility 
[ane of First Kind. when true) I | oC — 0:206 


Fee ee econ мл its fou) MB = 0007 


CRITERION of ACCEPTANCE 
for HYPOTHESIS A 
2с<259 


| 
(оо - fold sample) | 
i 


ылыы му? 


Fic. 134. "Testing the same exclusive alternative hypotheses as in Fig. 132 and same sample size, choice of rejection- 
acceptance criterion which makes the error of the second kind smaller, makes the error of the first larger. 


В 0:021. Thus the effect of reducing the sample size is to increase more than 4-fold the 
probability of an error of the second kind for a corresponding probability of error of the first 
kind. 

In this case we can make our two error risks nearly equal by setting our limits of rejection 
and acceptance for the null hypothesis on either side of the score x — 5855, in which event 
the null hypothesis sets the upper limit of acceptance at + 1-7o, and the alternative sets the 
lower limit for rejection at — 1:740. Thus а с 0:045 and В = 0:041. If P, — 0:9 as in 
our first example Р, = 95:9 per cent. For the 144-fold sample we obtained P, œ98-1 per 
cent. when the two conditional risks were nearly equal. 

Before we go further, we may well retrace our steps. We made the arbitrary decision to 
designate as our null hypothesis the assertion that the mother fly is normal. Actually, we 
have given no reason for doing so ; and we may pause at this stage to dispose of a misconception 
widespread among those who carry out routine tests within the framework of the unique null 
hypothesis. There is prevalent a somewhat naive view that we choose our null hypothesis as 
a saféguard against wishful thinking, and that we make accordingly our criterion of rejection 
as exacting as need be. On such a view our criterion of rejection is at best a disciplinary con- 
vention ; and as such has nothing to do with unconditional statistical inference. Also one can 
justify it as such only if one chooses the null hypothesis on the understanding that one wishes 
to fall backwards in preserving one’s rectitude, i.e. if the null hypothesis is actually the one 
the investigator has reasons for believing to be false. Evidently no recipe that the best Mrs. 
Beeton can prescribe will indeed meet one’s requirements in all situations. If experiments 
on laboratory stocks have convinced the investigator that a new therapy is preferable to a current 
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procedure, the enthusiastic research worker will not reasonably impose on the null hypothesis 
a criterion of rejection as exacting as that of the sceptical investigator undertaking experiments 
to test the credentials of extrasensory perception. In conformity with current procedure, he 
or she will nevertheless invoke a null hypothesis of the same type in either situation, and with 
the same convention (e.g. 0-05 significance level) of rejection, if accustomed to rely on current 
cookery book recipes. The reason is that the cookery book recipe will commonly prescribe 
as the appropriate null hypothesis the one which commends itself to the mathematician because 
he can manipulate it algebraically, i.e. for reasons which have nothing to do with the operational 
intention of the scientific worker. 

In the model situation discussed hitherto, we have, in fact, sidestepped the temptation 
to choose our null hypothesis for this reason, since it would be equally easy to adopt as such 
the postulate that the fly mother is a lethal carrier. A rejection criterion identical in terms 
of the conditional risk of error of the first kind, as is indeed the most we can specify within the 
framework of a unique null hypothesis, would then lead us to results numerically inconsistent 
with those we have so far explored. The reader may check this assertion by reversing the role 
of the two hypotheses in the foregoing examples. 

Partly because of the size of the samples chosen, previous tests in our model situation have 
led to a high probability of correct decision arrived at in conformity with traditional procedure, 
ie. within the framework of the unique null hypothesis. This may lead us to a totally wrong 
view of what we can rely on it to accomplish, if we fail to take stock of two background con- 
ditions plausibly invoked in the prescribed set-up, but rarely admissible in other situations, 


(a) we concede only one admissible alternative to the null hypothesis ; 


(6) we have postulated a complete specification of the sampling distribution in terms of 
the alternative thereto. 


It will be simpler, if we first examine the implications of (b). In all examples hitherto 
cited we have found that P, > 0-5, i.e. that more than 50 per cent. of our decisions will be right 
if we consistently follow the last prescription, in which event we shall be more often right than 
wrong. Now there is no reason why this should be so, other than the fact that we can here fix 
in advance the size of the sample and the criterion of rejection or acceptance for the null hypothesis 
with due regard to the value of the relevant parameters of both hypotheses. To clarify the relevance 
of the consideration last stated, let us now replace the female carriers of a sex-linked lethal gene 
by females with a virus infection to which their male offspring succumb somewhat more readily 
than their sister flies. We shall postulate a sex ratio of 11:9 in favour of females among the 
progeny of infected mothers. Our alternative hypothesis is now that p, = 0-55. 

On the new hypothesis which we again provisionally assume to be the only admissible 
alternative to the null one (р, = 3), we have M, = 55 and c, œ 4-98 for fraternities of 100. 
If we set our rejection criterion on either side of х = 60-5 we have as before (x — M,) = + 2-10 
and (x — М) = + 1-10, whence «=0-018 and В = 0-864. Thus (1— В) = 0:136 and 
(x — B) = — 0:846, whence from (i) 

P,c897 per cent. when P, = 0:9; 
P,= 22-0 per cent. when Р, = 01. 


This example illustrates the important role of the prior probabilities P, and P, = (1 — P,) 
which define the populations at risk under each hypothesis. If P, = 0-1 we have Р, = 22 per 
cent. and P, = 78 per cent., i.e. consistent application of the rule will lead us to be wrong more 
often than right when the sample is as small as 100, but we can fix the size of the sample to 
ensure that P, > 3 only if we can assign at least a lower limit to P,, and then only if we can 
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assign a value to В. Now we cannot assign a value to f unless we can specify the appropriate 
parameter (in this case p,) or parameters of the sample distribution of the admissible alternative 
hypothesis. In any case, it will rarely happen that we as easily conceptualise the meaning we 
can here confer on P,, and still more rarely that we can equip it with a numerical value. 

The considerations last stated do not exhaust limitations of current test procedure within 
the framework of the unique null hypothesis. We have so far assumed a single admissible 
alternative and we can very rarely, if ever, make such an assumption with propriety. Indeed, 
much statistical enquiry goes on against a background of an infinitude of admissible alternatives 
to any null hypothesis we may advance. In our model set-up we have already adumbrated 
this complication ; and we may now with profit postulate 3 admissible hypotheses. We shall 
then get into focus a general conclusion concerning the utmost we can legitimately infer in 
the domain of unconditional assertion from the outcome of a decision test referable to a unique 
null hypothesis in the absence of background information concerning admissible alternatives 
thereto. We may anticipate it by reinterpreting (ii) above. When B > ж in (ii), (x — В) is 
negative and P, — P, i.e. the uncertainty safeguard is less than the greater conditional risk. When 
B < о, (x — B) is positive and P, > В, i.e. the uncertainty safeguard is greater than the smaller 
conditional risk. 

The conclusions last stated refer to a situation in which only two hypotheses are admissible. 
An examination of a model situation in which three hypotheses are admissible will exhibit it 
as a particular case of a general proposition expressible as follows on the assumption that our 
concern is with the long-run proportion of true assertions we make on the basis of a test pro- 
cedure of the type under discussion : 


(i) the worst that can happen is that we shall exclusively encounter situations prescribed 
by the hypothesis associated with the greatest conditional risk (p,) of erroneous rejection ; 
(ii) the best that can happen is that we shall exclusively encounter situations prescribed by 
the hypothesis associated with the smallest conditional risk (p,) of erroneous rejection. 


Our new model will be that the following three hypotheses are admissible w.r.t. our fruitfly 
culture ; and we therefore start by assuming that we can define the relevant parameters and 
sample distributions referable to each of them : 


Hypothesis А : The female is normal, Р = 4 = 80. 


Hypothesis C : The female carries а sex-linked lethal, р. = $ = #0. 


We shall designate the proportions of the 3 types of female flies as respectively P,, Р„ Р, 

so that (P, + P, + Р,)= 1. In real life there is no reason to exclude the possibility that a 
lethal carrier could transmit the virus ; but we assume for argument that such flies are 100 per 
cent. resistant to it. We are free to select any one of the above as our null hypothesis ; and 
shall first assume that our null hypothesis is р = p,. In that event we may choose a single 
rejection criterion x > хь, thereby fixing the conditional risk of rejecting the null hypothesis 
when true as a, that of rejecting hypothesis B when true as В and that of rejecting hypothesis 
C when true as y. The conditional probability of an error of the first kind is «P,. We 
accept the null hypothesis erroneously, if we either reject B when true or reject C when true. 
Whence the probability of wrong acceptance is BP, + уР„ and the probability of making a false 
decision of one sort or the other is 

Р, = аР, + ВР, + yP . . ‘ : 5 = . (ii) 
This is equivalent to 

P,—(1— B) = 1 — aP, — BP, — yP.. 


^ 
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If our null hypothesis is p = p,, our rejection criterion must make у < since p, lies nearer 
to р, than does p.. If we define it so that о = В whence æ > у, we may write (iii) in the form 


P, Y — (P, + P) — УР, 
=1—o(l—P,) yP, 
o Р,=1— 9+ (= — у)Р,. 
Since ж > y on the assumption that « = B, (х — y) is positive and 
P,>1—a and P«« . * ` s . (iv) 


We have here arbitrarily chosen as our null hypothesis p = p,. In principle, the procedure 
would be alike if we chose as our null hypothesis p = р. If we choose the second hypothesis, 
it will be different, because we must now adopt a modular rejection criterion, i.e. we reject 
hypothesis В in favour of А if x < х„ and reject hypothesis В in favour of C if x > хь. We 
shall then denote the error of rejecting the null hypothesis when A is true by B, and that of 
rejecting the null hypothesis when C is true by B. Тһе probability of erroneous rejection 
is then P,(8, + B... The probability of erroneous acceptance is (4P, + УР,), and 


P, = РВ, + B.) + «P, + УР. 
If we choose our two rejection criteria so that ж = В, and y = fe we then derive 
P, = (Р, + РВ, + (Py + PB, 
= (1 — Р,)8, + (1 — Р,)В, 
^ P, < (Ba + В), 
bee great 8 Lu oss (v) 


Since the conditional risk of an error of the first kind is (В, + В.) =, the choice of B 
as our null hypothesis leads us to the same result as (iii), i.e. 


Р, >1— В. 


"Thus we can always choose our rejection criterion ог criteria to make the uncertainty safeguard 
less than the conditional risk of error of the first kind when either of two alternatives to the 
null hypothesis is admissible each being specifiable. With the same reservation we can make 
the probability of correct decision as near to unity as we care by making the size of the sample 
appropriately large. 

So far we have assumed a backstage view of the situation, i.e. that we can in fact specify 
precisely each admissible alternative to the null hypothesis; and it will rarely happen that 
we can do so. If we cannot specify either admissible alternative, we may restate the foregoing 
argument in more general terms recalling that the form of the uncertainty safeguard does not 
depend on the choice of a modular or vector criterion of rejection. If p, is the conditional risk 
of rejecting hypothesis H when true, we may write our uncertainty safeguard as follows for a 
situation involving only three hypotheses with definitive parameters р,, P», pe and prior prob- 
abilities P,, P,, P. : 


II 


P= Peace - E Я P . . (vi) 
h=a 
In this expression 
h=e 
Do aaa . : : + . (vii) 


h=a 
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The probability of wrong rejection is (Pax, + Pax.) = xP,. That of wrong acceptance is 
Р.В + Ру, and 

P, = «P, + PB + Pry : 5 ; 2 - (viii) 
In this case, we may note that the choice of the criterion x», so that В = жь and of x, so that 
y = «, implies 

P, = (P, + Py) + (Pa + Р) = (1 — Pos + (1 — Po)ttes 
D P, = а + ae — (Pos + Pree). 

Whence P, < х and in agreement with (iv) above P, > 1 — æ. However, we are here exploring 


a situation in which we cannot fix x, or x, to fulfil the condition stated, since we cannot assign 
numerical values to either рь or pe. If so, we can at least say that 
P, «ax В + у. 
We сап, however, go one step further. We shall now generalise the utmost we can legitimately 
infer from the performance of a decision test within the framework of a unique null hypothesis, as 
we have been accustomed to perform it, i.e. against the background of an unknown number (m) 
of admissible alternatives to it, and with no precise specification of any one of them. As before, 
we shall denote by p, the probability of rejecting the Ath member of the m-fold set when it is right 
and the corresponding risk of rejecting the null hypothesis (р = фе) when right by po, so that 
hem 
P, yx >: Py. Phe 
Kao 
Consider now the hypothesis for which the risk of rejection (p,) when true is greatest, so that 
€n.9 is positive if pa = (Pe — en.o) and e,., = 0, 


hem hem 


P,— p, 2. M x Pr- êro 
LT amo 
hem 
= Рас 2 Pe 
к=о 
..Р,<р, and P,21—p,. 5 5 = (ix) 


If р, is the smallest value of h so defined we may write p, = (p, + ел.) in which ej, is again 
positive and e,,, = 0, so that 


h=m h=m 


Pp Р, + > P, 6.5 
h=0 к=о 


.Р,> p and Р,<1— р, . 5 . . S 63] 

The situation last discussed suffices to get into focus the most we can say about the outcome 

of a single hypothesis decision test within the domain of unconditional inference when, as com- 
monly, we can neither state how many alternatives to it are each admissible nor specify each 
in numerical terms. If we denote by р, and p, respectively the least value and the greatest 
value of the probability of denying any one of the set of hypotheses when true in conformity 
with the rejection criterion chosen, the probability of a false verdict lies between limits definable 


as follows : 
P< Р, <р... © ба) 


Unless we can specify the parameters of each admissible alternative to the hypothesis chosen 
as the null one, we can say no more about p, in (xi) than that it is less than unity ; but if we 
can specify each admissible alternative hypothesis precisely, we can choose our rejection criterion 
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to make the probability (ж) of rejecting the null hypothesis when true, so that о = р, whence 
Р, <x. By appropriate choice of sample size we can then make the probability of a correct 
verdict on the null hypothesis as near to unity as we like without invoking any information w.r.t. 
its prior probability.* We thus arrive at the following conclusion: a test procedure may 
be informative in the domain of unconditional inference if, and only if, we can precisely specify 
each of an exhaustive and exclusive set of hypotheses. 

The last statement calls for qualification on two counts. A parameter f definitive of an 
admissible alternative to the null hypothesis (p = po) may be indefinitely close to ро itself. If 
so (Fig. 135), p, = 1 — po for samples of finite size and we can make both p, and ро indefinitely 


ALTERNATIVE HYPOTHESES INVOLVING NEARLY EQUAL PARAMETERS 


Meon(M) a 
Hypothesis A 19-8 5 
Hypothesis B. 20:8 5 2 bility 
CRITERION NCI ir = 
E SERENO, aee MIN 09: 
Error of Second Kind = о“ 
2с 28 урен Анел it нов) MEE З = 0-93 


Qoo- told sample) 


M,=20'8 2с=28 


Fic. 135, Testing Exclusive Alternative Hypotheses. The sample size and the variance of the u.s.d. for each 
hypothesis as in Fig. 132 and the null hypothesis (M, = 19:8) unchanged. By making our alternative hypothesis 
that М, lies very near M, without changing the size of the sample, we can make В œ (1 — a). 


small only by making our sample indefinitely large. This consideration has an important 
bearing on the concept of test power touched on below. Here it is relevant because we can 
rarely be certain that no such hypothesis alternative to the спе chosen as null is indeed admissible. 
This raises a question of pivotal importance in connexion with the foregoing exposition: in 
what situations can one postulate an exhaustive and exclusive set of admissible hypotheses 
which fulfil all the relevant conditions now stated ? 


* Neyman and Pearson (1933), “ Testing Statistical Hypotheses in Relation to Probabilities a priori,” Proc. Camb, 
Phil. Soc., Vol. 29. 
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An important class in which the postulate of an exclusive and exhaustive set of admissible 
hypotheses is legitimate arises in pathology when we can 


(i) classify test subjects as healthy or sufferers from a particular disease ; 


(ii) assign a probability on the basis of laboratory experience to the assertion that a single 
test will fail to identify them correctly. 


For heuristic purposes a criterion for screening tuberculous patients cited by Neyman 
will serve as a type specimen.* On the basis of laboratory experience, we assume that a single 
X-ray film will: (a) fail to detect the disease in 40 per cent. of sufferers; (b) give a 
positive result for 1 per cent. of healthy test subjects. Clearly we need to make more than one 
film, if we aim at a high level of satisfactory diagnosis. We shall assume that we take 5 and 
adopt as our test criterion the rule that we deem the disease to be present if at least one film 
is classifiable as positive. Our first which we may call the null hypothesis (hypothesis A) will 
be that the disease is present. Our test criterion leads us to reject the hypothesis if all 5 films 
are negative. The relevant parameter (p4) is the probability of failure, in this case 0:4. Hence 
the probability of rejecting the null hypothesis (ie. wrongly classifying the test subject as 
healthy) is 

a = (0-4)5 = 0-01024. 
The alternative hypothesis (hypothesis B) is that the test subject is healthy. If so, the pro- 
bability (дь) of getting a negative result from one film is 0-99 and that of getting 5 negative results 
is (0-99)5. We shall reject the alternative hypothesis if at least one film is positive, i.e. 
B = 1 — (0:99)5 = 0:04901. 

The reader will find it instructive to explore the outcome of different test criteria based 

on different sizes of sample (i.e. numbers of films per test subject) within the framework of 


the foregoing assumptions. In this context P, in (i) above is the incidence of tuberculosis 
in the population. Our truth equation is 


P,—1—B-—(x—B)P; 
= 1 — 0-04901 — (0-01024 — 0-04901)P, 
= 0:95099 -+ (0-03877)P,. 


Thus the test criterion ensures a probability of overall correct decision a little more than 95:5 
per cent. if the incidence of the disease is 1 per cent., and must inevitably ensure a figure more 
than 95 per cent. for an overall correct verdict in accordance with (xi) of 20.03. However, we 
shall now see that unconditional assertions of this sort are of trivial interest in connection with 
decisions of this kind, though the procedure illustrated may well have applications in the 
domain of differential diagnosis.T 

"Throughout our treatment of the model situations explored in this section we have assumed 
that the fly cultures are composite ; and that P,, P,, etc., specify existent subpopulations at risk. 
We have then the model situation to which Bayes’ theorem refers. In an actual situation we 


* 'The medical specialist will recognise some arbitrary assumptions in the argument here advanced for illustrative 
purposes alone. 

T The writer is greatly indebted to Mr. R. Wrighton for suggestions and criticisms incorporated in this and the 
ensuing section. Since it went to press he has called my attention to two important contributions which lay bare 
the limitations of the test procedures commonly employed in biological and sociological work. Jackson (Stat Res. 
Mem. I, 1936) introduces the concept of stringency, a test being most stringent if it assigns a minimal unconditional 
uncertainty safeguard (Wrighton) as here defined. V. Mises (Ann. Math. Stat. 14, 238) uses the term error chance 
in the same sense and speaks of the success rate of a test as equivalent to P, in the foregoing discussion. The term 
stochastic credibility suggests itself as of wider applicability in the common domain of test procedure and estimation. 
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might not know whether the culture is homogeneous or composite. Alternatively, we might 
know that the culture contains flies of only one sort without knowing which. From the viewpoint 
of Bayes' theorem, we might then state that one value of P, is unity and every other value of P, 
is zero ; but we should know the answer to our problem only if we could identify the hypothesis 
H which assigns Р, = 1. The test procedure for two exclusive alternative hypotheses sidesteps 
both horns of the Bayes’ dilemma. If we know the culture is composite, we need not know the 
contribution of each population at risk. If we know that it is homogeneous or if we merely 
know that it may be, the same recipe holds good, since two relations hold good for all values of 
P, and P, including as a limiting case P, — 0, P, — 1 or vice versa. In situations to which 
the Bayes' balance sheet is factually irrelevant, each hypothesis being referable to an existent 
population at risk, and in situations to which it is factually irrelevant in the sense that we cannot 
realistically conceptualise the sampling process in two stages, it is equally true that our uncertainty 
safeguard (Pj) lies between о and £, being equal to х if we design a trial to make х = В. 


20.04 THe Concept or Test POWER 


In the foregoing section we have examined a model situation, viz. a fruitfly culture, to throw 
light on the relevance of test procedure to unconditional inference, i.e. our concern has been 
to assign a probability to a correct decision for or against a hypothesis. On the assumption 
that the female deemed to be normal in this context is a new and valuable mutant, we might 
also formulate our problem in terms of conditional inference. Thus we may wish to curtail 
both the risk of letting lethal genes accumulate in our stock and the risk of destroying normal 
stock otherwise available for perpetuating it. Accordingly, we decide to screen our females 
by setting up a rejection criterion which will set an acceptable limit to the risk incurred in 
retaining a lethal carrier and an acceptable limit to the risk of losing an otherwise normal female 
which carries the mutant gene we seek to perpetuate. 

We can likewise, and usefully, regard the issue at stake in a diagnostic test such as the one 
Neyman cites as on all fours with decisions which arise in quality control, when the end in view 
is to ensure against incurring hazards respectively (vide 20.02) designated as producer's 
risk and consumer’s risk. The main preoccupation of the administration in the situation 
last discussed will in fact have less to do with an overall assessment of correct judgment 
than with the penalties of making mistakes of two sorts. To classify wrongly a tuberculous 
person is to deprive him or her of proper treatment. To classify wrongly a healthy person 
is likely to cause unjustifiable alarm and despondency. A test procedure which prescribes 
that neither risk exceeds what the authorities regard as admissible therefore satisfies the 
practical demands of the situation from their viewpoint. We may state these demands 
explicitly in the form : 

(i) if the test subject is tuberculous, the risk of erroneous diagnoses must not exceed a ; 
(ii) if the test subject is healthy, the risk of erroneous judgment must not exceed o. 


Any unconditional statement we can legitimately make in this context presupposes the 
possibility of classifying the test subjects exclusively as of one or other type ; but the adminis- 
trative intention does not change, if we postulate that an appreciable number of test subjects 
are unclassifiable by recourse to any available independent diagnostic criterion. The test 
need not then lead to consequences embarrassing to authorities content to disclaim responsibility 
for individuals unless definitely deemed to be healthy or tuberculous. Undoubtedly, there 
will arise in administration many comparable costing situations in which a conscientious claim 
for limiting the requirements of a test to such conditional assertions is admissible ; but the 
propriety of such a procedure in the domain of scientific research is at least open to debate. 


874 CHANCE AND CHOICE BY CARDPACK AND CHESSBOARD 


Recent literature on quality control techniques justifies the suspicion that some writers 
would advance the claim that conditional decision tests of this type are appropriate in the domain 
of the prophylactic or therapeutic trial. It is therefore pertinent to examine the relevance of 
the analogy between the end in view of the salesman and that of the research worker approaching 
a clinical trial against the background of laboratory experiments in vitro or on animals. In 
this situation the investigator will not lightly incur the risk of losing credit for a major discovery 
nor cheerfully shoulder the risk that subsequent enquiry will discredit his conclusions. 1f 
content to follow the practice of the large-scale commercial corporation, he will therefore invoke 
a test procedure which will set appropriate limits to the risk of wrongly rejecting the alternatives : 
(i) his own assertion that treatment B guarantees b per cent. more cures than treatment 4; 
(ii) the assertion of an imaginary critic that treatment B guarantees only a per cent. more cures 
than treatment A. By all too easy stages, statistical inspection then becomes a recipe for statistical 
careerism. The investigator and his putative opponent relinquish their proper relation as 
colleagues in the impersonal pursuit of truth to embrace a convention which safeguards the 
amour propre of each. The decision to make the best of a bad job in this sense involves an 
ethical issue which is not amenable to arguments likely to win universal assent ; but it carries 
with it an implication which may well damp the enthusiasm of the convert. This will come 
into focus, if we here digress to clarify the Neyman-Pearson concept of test power. 

In the taxonomic domain of the 2-class universe we specify ж and £ in the following way 
for the r-fold sample when the criterion for rejecting hypothesis A (р = Pa) and hence for 
accepting hypothesis B (p = рь) is x >t: 


x > тор —p)-*; 1—« B Tatil — py 4 se) 
т=@-1) jue 
B= È rl р): 1—8— 2. тау" T @ 


What Neyman calls the power function F(p) of the test for the same size (7) of sample 
and the same criterion score (f) is picturable as the graph of the following function over the 
range p —0 top — 1: 


тетп 


ЕФ) = È nap — py | . o 
It follows that T 
F(p,) = and F(p,)=1—8 "E . 5) 
For a given value of r and of t, the condition that « — В is, of course, 
Fe)=1-Fip) . . . . . .% 


Having fixed any criterion for rejection of the null hypothesis (A), and having chosen 
the alternative hypothesis (р = рь), we speak of F(p,) as the power of the test. This being 
(1 — B) is the probability of rejecting the null hypothesis when it is false, on the assumption 
that the alternative is the only admissible one. One test prescription is more powerful than 
another if it has a higher power in this sense for a fixed value of а, i.e. if it assigns a lower pro- 
bability to error of the second kind for the same probability of error of the first. If the two 
test prescriptions both invoke the same distributions, the test which employs a larger sample 
must be the more powerful one. 

The reader will find it instructive to plot F(p) against р for the following example of a test 
procedure. "The null hypothesis is that p= 3 when r = 144. The rejection criterion is x>82:5, 
For the distribution prescribed by the null hypothesis the mean is 72 with о — 6. Whence 
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the criterion score in standard form is (82-5 — 72) + 6 = 1-75. This excludes 4 per cent. 
of the area of the normal fitting curve, i.e. ж = 0:04. For this set-up we may tabulate as below : 


TABLE 1 
Ф M Х-= (825 – М) o с=Х +0 B ЕФ) =  — A) 
# 60 22.5 59161 3-8032 > 0-999 «0-001 | 
н 66 16:5 5:9791 2-7596 0-996 0-004 

ES 78 45 5:9791 0-7526 0:773 0:227 | 
н 84 8 59161 —0-2535 0:401 0-599 | 
н 90 —75 5:8095 —1-2910 0-099 os | 
н 96 -135 5.6568 2.3865 0-013 0-987 | 
H 102 —19:5 5:4544 —3-5750 «0-001 20-999 | 


"The concept of test power is easily interpretable in the alternative domain of representative 
scoring. The simplest type of test is then one which invokes alternative hypotheses specifying 
the mean score of the u.s.d. for each of two normal universes. Consider now the following 
model. We do not know the mean value (M) of the normal variate ; but we do know that the 
variance of the u.s.d. is 2500. Whence that (o2) of the mean of the r-fold sample is 2500 - r. 
For the 100-fold sample o, = 5. Our null hypothesis is that М = 18-2. Тһе standard score 
corresponding to a sample value (M,) of the mean is therefore (M, — 18:2) -+ 5. To make 
a = 0-05 we must make the deviation equal to 1-640, i.e. (M, — 18:2) = 8:2, whence M, = 26-4. 

The alternative hypothesis which makes В =0-05 is that (М, — М) — om = — 1-64, 
so that (26:4 — M) = — 5(1-64). Whence the hypothesis is that М = 26:4 + 8:2 = 346. 
If our alternative hypothesis were that М = 28-2, the score deviation would be (26:4 — 28-2) = 
— 1-8 or — 0:360. At this level 8 = 0:359. To make the two risks equal when the sample 
size is 100 and the alternative hypothesis is М = 28:2 we must choose the sample value (Му) 
definitive of our rejection criterion, so that 

M.—182 (М. — 28:2) 
a Ба. 
In this case М, = 232, i.e. (М, — 182) = 5 = om, so that х = 0-159 — В. То equalise 
both risks as nearly as possible at the level х = 0-05 = В, when the alternative hypothesis is 
that М = 28-2, we must enlarge our sample size (r) so that om = 50 + 4/7 in the identity 
232 — 18-2 164 (23:2 — 28:2) 


om Om 


Whence we get 
у = 164. 
Whence r = 269 to the nearest integer. 
We may generalise the rules of test prescription thus : 


(i) to fix « at adm level we make our test criterion 


CEMI Ti сш t = Ma + hao S s э uo 


om 
15° 
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(ii) to determine B in terms of /;,, we then have 


—(t— M, - 
h, = 62м) = (vii) 

(iii) to equalise the two risks without changing the size of the sample we make 
KEM HMM tn ES 

Ds CIS 
(iv) for equal risks we specify ж in terms of h,o,, by the relation 
oR ota d c ce NN 
Om 20m 


(у) to equalise risks at the level ж = 0-05 = (so that h, = 1:64 = — h,), we must 
change the size of sample from r, to 7 so that the new value of om is r}. 77!o,, and 


Qn—M ` : mE) 


The reader will easily adapt the foregoing to the situation in which we require two para- 
meters to specify the normal universe of a hypothesis, viz. М, and o,. For the simpler case 
under consideration, the power of the test being (1 — В) for any alternative to the null hypothesis 
is expressible in the form 
_t—M, 


Om 


h (xi) 


We may then write 


нм) = — |e de EC T. Gi) 


We may now make an exploratory table for test design as follows on the assumption that r — 100, 
Om = 5 and t = 264, so that х = 0-05 when M, = 182: 


TABLE 2 

alae t M Pd ы es 09 m e? 
lue of o! 

definitive of | rejection () | Corresponding test pori Valus af 

alternative expressed аз | value of В criterion Ew en" 

hypothesis Ps а-# кер е 06 ар 
184 =16 0-945 0-055 0-492 672,400 
194 m 0-919 0-081 0-452 18,678 
22.4 —0:8 0:788 0:212 0:337 1,525 
24:4 —0-4 0-655 0-345 0-268 700 
264 0-0 0-500 0-500 0-206 400 
284 04 0-345 0-655 0-154 259 
30-4 08 0:212 0-788 0-111 181 
32.4 12 0:115 0-855 0-078 133 
344 16 0-055 0-945 0-053 102 
36-4 2-0 0.023 0-977 0-034 81 
38-4 24 0-008 0-992 0-022 66 
40-4 28 0-005 0-995 0-013 55 
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Since the size of sample fixes the power of the test for a fixed value of ж, we can set В at 
a predestined level appropriate to any single chosen alternative of the null hypothesis only if 
we plot P, for different values of 7. Table 3 sufficiently illustrates the procedure ; and the 
reader may find it instructive to check the arithmetic by recourse to the foregoing equations. 


TABLE 3 


Power function (P,— 1 — B) for the same model as in Table 1, tabulated separately for different values of sample size 
т, with the same rejection criterion (x = 0-05) for the null hypothesis (М = 18:2), when om = 5 for the 100-fold 
sample. As the head of the columns are score values (M .) corresponding to the condition « = 0-05, and values of 
ст for the appropriate value of r. 


| Size of Sample 
Hypothesis 81 144 256 324 
om = 416 on = Om = 2:6316 
M, = 25-03 M.- | M.—2252 
19 0-073 0-082 | 0-090 
| 21 0-186 0:227 0-281 
23 0-312 0:456 0-571 
25 0-496 0-702 0-826 
27 0-681 0-879 0-955 
29 0-829 0-965 0-993 
31 | 0-924 0-993 | 0-999 
33 | 0-972 0-999 | 0-999 
36 0-996 0-999 0-999 
39 0-999 0-999 0-999 
41 0-999 0-999 0-999 


We are now in a position to see more clearly the implications of approaching the inter- 
pretation of the outcome of a prophylactic or therapeutic trial as one of accommodating the 
producer's risk and the consumer’s risk in the theory of quality control. If we do so we conceive 
the test procedure as a game of chance in which the investigator arranges the stakes to accom- 
modate the inclinations of a wholly imaginary contestant. His assertion is that treatment B 
guarantees b per cent. more cures than treatment A, and this fixes the value of b. His fictitious 
opponent asserts that treatment B guarantees only a per cent. more cures; but because his 
opponent is merely a figment of his own fears, all that he can say about a is that: a < b. If he 
conceives that his opponent is ready to deny any operational advantage (a — 0) for treatment B, 
he may set his own risk as equal to that of his opponent at a much lower level for a fixed size of 
sample than will be possible if his opponent makes a far more moderate claim (e.g. a — 15). 
Alternatively, the design of a test to equalise risks at one and the same level will prescribe the 
availability of larger samples, if he conceives that his opponent, having first denied any advantage, 
will subsequently concede that there is some. 

Having chosen the form of his own assertion (here the numerical value of 6), the only 
exclusive admissible alternative with which he can equip the imaginary disputant of his claim 
isa <b; but the alternative test procedure then prescribes recourse to an infinite sample as 
a prerequisite to a firm decision. Within the restricted framework of conditional inference, 
the alternative test procedure can thus offer no simple nor unique recipe for validifying the 
operational advantage claimed for a new procedure. Should the reader find the foregoing 
argument obscure, it may help to clarify the issue, if we go back to the data of Tables 2 and 3 
(in which e, = 5 when r = 100). We shall suppose that: (i) disputant A initially asserts 
that М = 18-2 and disputant B initially asserts that M = 26-4; (ii) both disputants initially 
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agree to accept the outcome of a test which vindicates the claim of B if the 400-fold sample 
value of M, exceeds 22:3. In that event each takes а 5 per cent. risk of being discredited. We 
now suppose that an arbitrator persuades disputant 4 to concede that M — 19 and disputant 
B to concede that M = 25:6 still taking equal risk on the outcome of a 400-fold trial. Disputant 
A will still lose his case if М, > 22:3, but each disputant now incurs a 26:8 per cent, risk 
(® = 0:2676 = B) of getting an adverse verdict. 

From the foregoing heuristic discussion the reader must not infer that the quality control 
procedures permit us to assign uncertainty safeguards only to conditional assertions. This is 
Not so, as we shall now see. Throughout this section we have provisionally presumed a distinc- 
tion between conditional and unconditional assertions in terms of the uses to which we put them. 
This is clear-cut in the sense that : (a) any statement worthy to rank in the corpus of scientific 
knowledge is one which we can rightly describe as unconditional in the sense elsewhere defined ; 
(b) statements of the conditional sort suffice as a basis for administrative decision. It is none the 
less possible to formulate rules of decision leading to unconditional statements of a sort rarely, 
if ever, relevant to the domain of research in pure science and no more useful to the administrator 
because more comprehensive in scope than a corresponding statement expressed in the more 
restricted form. Further consideration of the Drosophila model of 20.03 will make this clear. 

In 20.08 we set up two hypotheses H, that p = 3 = p, and H, that p = $ = p», p being 
the probability that any offspring of a particular mother will be female. If we make the rule 
to reject Н, if x > а + 3 for the r-fold sample and denote by L,., the probability that it will 
contain x females if p = р,, we may assign as the risk (2) of rejection when H, is true : 


Similarly we may adopt H, as our null hypothesis and make the rule to reject it if x < b -+ t 
‘The corresponding conditional risk (В) of rejection is then 


РЕТ) 


B È Lo 


In either case, we attach an uncertainty safeguard (x or В) to a statement which is conditional 
in the sense that it refers to a risk we take of being wrong if a particular hypothesis is correct. 
Unless a — 5 the simultaneous application of the two tests will not necessarily lead to a decision 
in favour of either hypothesis; but we can formulate a composite rule which must do so in the 
form: reject Ha if x >k + $ and reject H, if x < (k + 3); and we may be able to choose 
k so that а cy c В, if r is fairly large. This leads to a conditional assertion which assigns y as 
the risk that we shall reject either hypothesis if true ; but we cannot assign an acceptable safe- 
guard to any unconditional assertion about the outcome unless the hypotheses so stated constitute 
an exhaustive and exclusive set. We can make а more comprehensive type of statement if we 
restate our hypotheses in the form H, that p < p, and H, that p > рь; and may still guarantee 
the termination of the test in a firm decision, if we follow the same composite rule of rejecting 
H, when x > (k + $) and rejecting H, when x < (k + 4). We then define L,., and Ls.» in 
terms of р, and p, as before; and бх k so that 


wer zek 


Deva =e > Ly.» 
z=(k+1) z=0 
Any value p < p, then makes the conditional risk of rejecting H, in its new form less than 
а; and any value of p > p, makes the conditional risk of rejecting H, in its new form less than о, 
which we may assign at any acceptable level if free to prescribe the sample size (r) in advance, 
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as in 20.01. The rule itself limits our positive statements to the alternatives p > p, and p <p». 
It prohibits any statement about an interval in which p lies, e.g. any statement of the form 
Po <р «p, To any assertion it does entitle us to make we may attach an uncertainty safeguard 
P,., < а. Since this sets а limit to the probability assignable to any false statement we may 
make, we are entitled to say that P, < « unconditionally defines the uncertainty safeguard of the 
entire class of statements which the rule subsumes ; but we can state this only because the rule 
subsumes no simultaneous statement concerning the relation of p to both p, and ру. 

If we know that the Drosophila culture contains several different genotypes to which we 
can assign values of p, we can meaningfully postulate prior probabilities referable to existent 
populations at risk to formalise the unconditional character of the final statement which the rule 
endorses. We must do so with due regard to its content, viz. the probability of wrongly rejecting 
the hypothesis р, < p < рь is zero, since the rule does not allow us to reject it. We may then 
set out the argument in terms of the following symbols, e being positive : 


Hypothesis Prior. Probability ME. ioo sii , 
15 «5 . : . = Ер. . В e Р,.ү=@—с‹ү 
2.р = р, б s è зш eB 5 : e Р,.,=«@ 
Bip p< iti ы ОСОР. РЕГ 
4p =p, : А А Sm WB А К "RED JO" 

5. p b : : j uA . Р, e Р,.,=—е; 


"These hypotheses constitute an exclusive set among which we can accept only опе. Hence the 
addition rule applies, and our unconditional uncertainty safeguard is 


P, = P,. P,., + Po. Py.2 + Р,.Р,. ++ Р,.Р,., +Р,.Р,.; 
= Р(х — є) + Pa. ж +P. a + Рә — є) 
=(1—P,)x — Р,.є — Р,. є; 

Р, Sa. 


The prescription of such a rule presupposes two target values of p which we can readily 
conceive in relation to standards of quality and to costing limits in an executive set-up, but the 
unconditional form the terminal statement assumes when we formulate a rule in this way embodies 
no relevant information other than the content of two types of conditional assertion. What the 
choice of the single rejection-acceptance criterion k accomplishes is that the inspection plan 
itself achieves its task, i.e. the test must lead to the decision to reject either H, or H,. In 
fact, both hypotheses may be wrong; and the unconditional form of the assertion is realisable 
only because the test can never lead to a corresponding assertion, i.e. a statement to the effect 
Pa <P <р. 

If we operate within the framework of a single hypothesis stated in the form p < p, or 
P > py and have defined our rejection criterion so that Р, < ж is the probability of rejecting it 
when true, we are free to limit our verdicts, as R. A. Fisher does indeed prescribe, to the alter- 
natives: hypothesis false and hypothesis unproven. In the sense chat P, < « is then the pro- 
bability of erroneously making an allowably decisive assertion, we might admittedly say that 
P, < is the unconditional safeguard of our test procedure. We then evade the Neyman- 
Pearson error of the second kind by exposing ourselves to situations in which the overwhelming 
majority of our decisions will assign the verdict unproven to a false null hypothesis. We can 
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indeed avoid doing so only by prescribing sample size with due regard to the Neyman-Pearson 
concept of test power ; but any attempt to rehabilitate the Yule-Fisher significance test on such 
terms undermines previous claims concerning reliability of inference referable to small samples. 
We shall examine the implications of the last statement more fully in 20.08. 


20.05 A SEQUENTIAL TEST PROCEDURE 1 


We are now in a position to reinterpret the issue raised at the end of 20.02, i.e. the interpretation 
of Sequential Ratio limits ; and shall do so with special reference to the type of alternative test 
procedure called the double dichotomy due to Wald. It will help us to understand its rationale 
if we first briefly examine a unique null hypothesis test which employs the same principle. 
Wald’s non-sequential so-called exact test presupposes that we can pair off unit samples from 
each of two universes which may or may not have the same composition w.r.t. a particular 
criterion of classification. For instance, we may take cards with replacement one at a time 
from each of two packs I and II, not necessarily complete, setting out the results as below : 


From I From II No. of pairs Total 
Concordances Red | Red 30 
Black Black 16 т 
Discordances Red Black | 12 
Black Red | 24 ^ 


The null hypothesis is that the two packs I and II are identical w.r.t. colour composition. 
If so, the two possible types of discordant pairs must occur with equal frequency in the long 
run. If pack II contains a higher proportion of red cards, pairs of types B — R should occur 
more often than pairs of type R — B. Accordingly, we disregard the concordant pairs, adopting 
as our null hypothesis that the unit trial probabilities р of getting B — Rand q of getting R — В 
are equal, ie. р == $ = 4. The expected value for a sample of 36 is therefore 18 for each type. 
If p = $ = the variance of the raw-score distribution of the 36-fold sample of discordant 
pairs is 36 x 4 x $—9sothat о = 3. Now the deviation of the observed number of B — R 
pairs from its expected value is 24 — 18 = 6. To evaluate the probability that the deviation 
will be as great as + 6 we require the area of the histogram in the range from 0 to 23, For 
samples of 16 or over the normal curve of unit variance gives a good quadrature approximation 
(a real fit) for the terms of the binomial (3 + 3)' if we make the half interval correction. Thus 
our concern is with the area of the normal curve of unit variance from — co to 


(23 — 18) , 
=a = 1:83. 


The table of the normal integral shows that the area so defined is 0-966. If the null hypothesis 
is true the odds are therefore about 30 : 1 against getting a score of 24 or more B — R pairs in 
a 36-fold sample of discordant pairs. If we wish to test whether m discordant pairs of a given 
type exceed expectation (4r) significantly, we may cite the exact probability of getting a score of 


т or more as 
z-r 


T а л 1 
PAOR "= 2 eal 


z-m тет 
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With due regard to the half interval correction, the appropriate critical ratio (standard score) is 
A m—i—k 2m— Кең 
ivr vr 


If r is larger than 16 we may safely use the figure given in the normal table for the area from 
— co to €m to evaluate the probability that the score will be less than m if the null hypothesis 
is true. 


Double Dichotomy Sequential Test. Wald’s non-sequential test last described is a test 
which involves a unique null hypothesis. A sequential test based on the same method of classi- 
fying the data, i.e. rejection of all concordant pairs, presupposes a hypothesis (p, = mp, = 3m) 
alternative to the null hypothesis (p, = 3). If we designate discordant pairs of two series 
A and B respectively as successes ( — +) and failures ( + — ) our alternative hypothesis is 
then that the probability of success so defined is Jm. Since we can label our pairs at choice 
we' may formulate the alternative on the assumption that successes are more common than 
failures, ie. 1< m <2. 

If x is the number of pairs labelled as successes, we may then proceed to define a 
sequential ratio in the usual way for an 7-fold sequence of pairs as 


Pig 1 
BW 7 т(02— т)" 
"The reader will recall the prescription for any S.R. test is as follows. We continue to 
enlarge the sample until 
either 5, >A in which event we accept the null hypothesis ; 


or S, <B in which event we reject the null hypothesis. 


Let us now recall the pattern of an S.R. test as set out in 20.02. "Though we define the 
criteria of rejection in terms of the numerical value the ratio S, reaches, any prescribed value 
S, = A referable to the completed r-fold sample presupposes that the corresponding raw score 
has not exceeded the particular value x = a, and any prescribed value S, = B presupposes that 
the corresponding raw score has attained a particular value x — b. In short, the test prescription 
implies that we terminate the test for the value of at which S, > A or S, < B by 


accepting the null hypothesis if x < a 
rejecting the null hypothesis if x > b. 
When x = a and S, = A, our alternative hypotheses prescribe 


s, = Pe $ E X a ull) 


M We 

When x — b and S, — B, our alternative hypotheses prescribe 
E m 1 E ^n 
De = ha = mE ту? ny = iles Я 5 д 3 700) 
We may make the alternative hypotheses more comprehensive with a view to an unconditional 
form of statement en rapport with the argument of pp. 878-9 above, if we put pa < and p, > 3m 
without affecting the choice of a and 5 implicit in the rejection criteria S, — A and S, — B. 
For a given sample size (r) we may likewise define a and 5 in terms of the conditional risk 
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(P;.a < о) of erroneously rejecting and the conditional risk (Р,., < В) of erroneously accepting 
the null hypothesis, i.e. rejecting the alternative when true. Thus we may write 


z-r z=(b—}) 
a= È е пәр" and В = 2 "fd t. -. . . (ii) 
z=(a+ z- 
When pa = $ and p, = 4m 
= 2-0-0 
a=2* У y, and p—2* У rnam(—my-; 
z-(acÓ) z=0 
=). "e 
(1—-3-2* $ n and (1-8)—2* © пано my. 
z-0 z-2(0-D 


Since х and В suffice to define x = a and x = b for the value of 7 at which the test terminates, 
we may hope to fix S, = A and S, = B to ensure that the unconditional uncertainty safeguard 
(Py) for a decision one way or the other exceeds preassigned values of neither х nor d. The 
fact that the test may terminate when р, < р < p, is then irrelevant, since our verdicts are of 
only two sorts, p <p, or p > p». The clue to the relation we seek is that: (i) В and (1 — х) 
are each referable to advancing totals of a binomial summation, i.e. from 0 up to b or from 0 up 
to a; (ii) ж and (1 — В) are each referable to receding totals, i.e. from r down to (a + 1) or 
from r down to (b + 1). We shall now state, but without proof at this stage, a rule connecting 
the sequential ratio with the two classes of totals : (a) the ratio of corresponding advancing total 
frequencies is greater than or equal to the terminal sequential ratio (22977 — 574; 7) of the 
sequence ; (P) the ratio of corresponding receding total frequencies is always less than or equal 
to the initial sequential ratio of the sequence. The following numerical example for the 4-fold 
sample distribution when р, = $ and p, = $ illustrates the meaning of this assertion, y, and y, 
being relative frequencies on the same scale (44): 


х= 0 1 2 3 4 
Ура = 4) . : fi 16 64 96 64 16 
УМР = 8) - с e 1 12 54 108 81 
Advancing Sum 16 80 176 240 256 
Totals 1 13 67 175 256 
Receding Sum 256 240 176 80 16 
Totals 256 255 243 189 81 
Ratio of Advancing Totals 16 6-2 26 14 1 
Ratio of Receding Totals 1 0-94 0-72 0-42 0-20 
Sequential Ratio . : 16 53 18 0:59 0:20 
From (i) and (її) above we therefore see that 
1—a a 
>A ad ——«B. : " 5 - (iv 
B me (iv) 


To make the meaning of these inequalities clear, let us first notice that diminishing either « or B 
makes the left hand ratio larger and the right hand ratio smaller, e.g. 
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x = 0-10 x = 0:05 а = 0:05 a = 0-025 
В = 005 =В В = 0025 = 
= © ЖГ 19 38 39 
а 2 Л. 2 А 
1—p 19 19 39 39 


Let us now fix A = 20 as our acceptance criterion for the hypothesis p < p, and B = L as our 


20 
alternative criterion for acceptance of the hypothesis р > p,. In accordance with (iv), we have 
then said that 

1—« a 1 
B >20 and т=8^® 
We see from the above that this implies that х апі В must then both be less than 0-05. Ву 
+ tabulating (1 — )8-? and «(1 — 8)-* for descending values of х and descending values of В we 
can thus see what sequential ratio limits are consistent with assigning our conditional risks at 
prescribed levels Р, „ < х and Р, „ < B. Since the test permits us to make only two sorts 
of statement the overall risk of erroneous decision is P, < « if « > B and P, < B if B > a. 
A proof of the rule stated w.r.t. ratio of advancing and receding totals for 2 binomial series 
is elementary ; and it will suffice to consider the case which arises when p, = $ and p, = 4m 
in which 1 <m <2. In this case, we may put т = (1 + е) in which e is positive, so that 


m 1+е 
k= Dec EHI 1. 
Our acceptance criterion is 
S 1 
“= my 


The ratio of the frequencies of the sum of scores less than or equal to a is 
aes 
Tx) 


z=0 
Каа: 


> rx) .т(2— my 
z-0 
We require to prove that R, > S, and if R, = K.S, that K 71. This implies that 


z-a 


AN Tiz; .m*(2 — m) 


ERO e 

> Te) .m"(2 — m)" 

z-0 

z=a z=a 

X€rna.m(2—my* PX CU al 
оке Ei 

У л. .т(2 —– т)* Ута Е 

z-0 т=0 


Now every value of x in the denominator of the expression on the right is less than ог equal 
to а. Since then k > 1, corresponding terms in the numerator are greater than those of the 
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denominator, whence К >> 1. The reader should be able to complete the proof for receding 
totals in the same way. The generalisation of the rule for p, > р, when p, is not equal to 0:5 
is trivial, since the relevant ratios are then expressible in terms of рь = 1m, and pa = }m,, 
in which m, > Ma. 
Let us now return to our test prescription, viz. : 
(i) continue to enlarge the sample if А > S, > B; 
(ii) when S, > А terminate the test by accepting the null hypothesis ; 
(iii) when S, < B terminate the test by rejecting it. 
We have elsewhere (20.01 and 20.04) offered alternative interpretations of A and B. If we 
set а = 0:05 = B our choice will be A = 20 and В = 0-05. The procedure is then reducible 
to rule of thumb. If S, >A 
m'(2—my^*« + 
ox log m + (r — x) log (2 — m) < — log A, 
ive «log Atr log (2 — m) 
log (2 — m) — log m 


(у) 


1092-1094 


ie. х<1301-(04176)г. 
030 


SCORE 


5= Yoo implies oc »logO-O5-r(log3 -log 2) 


dá i log2-log4 

Io | ie. x > -О:699-(О-176\)г 
! -O30! 
{ 


35 100 


Fic. 136, The Sequential Ratio Test Prescription for Double Dichotomies. The limiting ratios are 
9(9:1) and 0-1 (1 :9) as in the example. 

We can make a graph (Fig. 136) of values the linear expression on the right of (v) assumes 
for different values of r terminating the test in acceptance when x falls below the line. Similarly, 
the condition S, « B implies 
1 
P 

log B + r log (2 — m) 
ae log (2 — m) — log m 


m”(2 — my} > 


(vi) 


SECOND THOUGHTS ON SIGNIFICANCE 885 


The example on p. 855 will suffice to illustrate the use of (v) and (vi), since we have made 
Р. = } and рь =$ = $5. so that т = $. For the 8-fold sample we there cited x < 1 for 
S, 29 and x >7 for S, «0-1. Thus (v) and (vi) become 


log 9 + Slog 2 — 8log3. 


-— log 2 — log 4 : 
8 log 2 — 8 log 3 — log 9 
Mz ae 


This gives as the lower value x < (0-4450 — 0:3011) — 1-4 so that only scores of х = 0 
ог 1 satisfy the acceptance criterion and x >(2:3726 ~ 0:3011) = 7-8 so that only the score 
x = 8 satisfies the rejection criterion as we have already shown directly. 

If we invoke a sequential test of this type, we accept the onus of assigning to the parameter m 
a meaningful numerical value. In many biological enquiries, such as the clinical trial, we have 
little to suggest an appropriate figure. To get this dilemma into focus, let us recall the urn model 
at the beginning of this section. We shall denote by p, the proportion of red balls in Urn I 
and by p, the proportion of red balls in Urn II. The complete set-up is then as follows : 

Concordances (+ +) pipa (-— —2)0—29); 

Discordanes (+—) p(1—p:)  (—+) (» —P)h« 

Our null hypothesis is that 
(1 — Р) 1 P(1 — pr) i 
Pill — Ра) + pall — ру) Pill — po) +2401 — pi) 


This is necessarily true if Urn II contains the same proportion of red balls as does Urn I, i.e. 
Фу p. The alternative hypothesis implies that 


m p(l — ps) = —Pa— Pas 
2 pl —pi)+Pi(1—P2) Р — Piba + Pr’ 
^ тра — 2pipe + фу) = 20s — Arps 
mp, = (2 — т)рь + 2ру(т — 1); 
E ы NR 
2 — m+ 2p,(m — 1) 


If we can cite a reliable figure for p, referable to the first urn, we can now interpret m in terms 
of operational advantage, ie. р — fı» Otherwise, the outcome of the test has little bearing 
on its presumptive aim. 


ГА (vii) 


20.06 ESTIMATION AND CONFIDENCE 


"The need to distinguish between two types of statistical inference as conditional and unconditional 
arises from two domains in which we can apply statistical principles in everyday life, namely : 
(a) the regulation of affairs; (b) the process of discovery. In commerce, manufacture and 
social administration we need rules of conduct to safeguard us against known risks. Our concern 
is then less with the truth of a principle than with the consequences to ourselves when it happens 
to be true or false, as the case may be. We do not therefore invoke statistical reasoning to 
justify our confidence in the truth of a particular hypothesis. All we need to know is how 
often a particular course of action will expose us to the penalties of rejecting its truth. This 
essentially conditional conception of the use of statistics has a long history in connexion with 
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the rise of insurance, and is unexceptionable in its right place ; but it has little relevance to 
what men of science have hitherto regarded as the proper goal of scientific research. If the 
legitimate scope of statistical reasoning has no concern with impersonal judgments about the 
truth of hypotheses, we must either dismiss its commonly asserted claim to be an essential 
component of scientific interpretation or abandon the traditional ethic of the scientific worker. 

Our examination of the use of test procedures in 20.03-20.04 has led us to the following 
conclusions : 


(i) the issues raised in the construction of the balance sheet of Thomas Bayes refer to 
situations in which the end in view is to pass judgment on the truth of one or other 
of a set of hypotheses referable to existent populations at risk ; 

since the terms of reference of conditional statistical inference, as here defined, exclude 

judgments of this sort, the balance sheet of Bayes has no bearing on the admitted 

usefulness of decision tests within the legitimate province of conditional assertions ; 

(iii) if circumstances entitle us to limit the range of admissible hypotheses which invite 
a verdict, it may be possible to devise decision tests which set an acceptable limit 
on the probability of a false choice without assuming that more than one such hypothesis 
is indeed referable to an existent population at risk ; 

(iv) since such circumstances will rarely arise in the conduct of research, the scope of 
unconditional statistical inference is very restricted, if exclusively reliant on test 
procedure ; 

(v) if we hold that unconditional statistical inference is an important feature of scientific 
interpretation, we can therefore justify its claims as such by invoking an alternative 
procedure. 


In statistical theory the term interval estimation has lately acquired a special meaning to denote 
such an alternative. We can define it naively as in 20.00 to emphasise what distinguishes the 
end in view from that of the decision test, or in a more sophisticated way, as later, to exhibit 
the pattern common to each procedure. At the outset, however, it is essential to be clear about 
what we do not mean by estimation in this context. Emphatically, we do not here mean, as 
is implicit in the all too common expression the best estimate, a procedure which assigns some 
unique value to a parameter of a universe, e.g. the proportion of cards of a particular denomina- 
tion in a pack or the true mean score of the toss of a die. 

"The use of the epithet best (and the preceding definite article) qualifying the word estimate 
is so widely current as to justify a brief digression, since its literal semantic implications are 
indeed wholly inconsistent with a modern attitude to the sort of statements which estimation 
procedure undertakes to justify. In short, we approach the problem of estimation with an 
emotional block at the outset, unless we realise that the end in view is not to cite some single 
best figure. A so-called point-estimate is not one to which we can assign an acceptable uncer- 
tainty safeguard within the domain of unconditional statistical inference. In different contexts, 
writers on statistics attach the adjective best to a unique sample estimate to signify that it is : 
(a) unbiased ; (b) most efficient; (c) sufficient. The first merely means that we arrive at it 
by a process which would lead us to the right answer if we repeated it on similar samples suffi- 
ciently often, an assertion which does not get us very far if we have only one sample at our 
disposal. The second signifies that the method we use to derive it would ensure the least 
uncertainty about the range in which it lies; but does not imply a precise specification of the 
location of the latter. The third signifies that it embodies all the relevant information the 
sample supplies; but tells us nothing about what conclusions the relevant information entitles 
us to draw. 
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With these distinctions in mind let us consider a conundrum beloved by pedagogues of 
the more prosy sort. If I have tossed ten times a penny which came down heads upwards every 
time, what can I conclude about the probability that it will come down heads next time? 
If we denote the single spin probability of heads by р, the best estimate of р in each sense of 
the term as used above is then p = 1, since (i) the observed proportionate sample score of a 
binomial variate is an unbiased estimate of the unique parameter р; (ii) the variance of the 
binomial distribution is zero when p = 1 ; (iii) the parameter p suffices to define the distribution 
for an assigned sample size. My so-called best estimate will thus signify that the penny bears 
a head on both faces.* 

The modern viewpoint associated with the terms confidence and interval estimation repu- 
diates the undertaking to make any such statement. What it does undertake is to specify a 
range of values (confidence interval) within which a parameter lies. In conformity with our 
initial definition of statistical inference (20.00) such a specification presupposes an uncertainty 
safeguard. In other words, we say in effect: (a) the appropriate answer (i.e. limits assigned 
to the range) will not be invariably true ; but it will be right nine times out of ten or ninety-nine 
times out of a hundred or with whatever corresponding frequency you care to assign; (b) how 
precise an answer I can give you (i.e. how narrow the prescribed limits of the range) will depend 
on how much liability to error you are willing to condone ; (c) when you have made up your 
own mind about how much fallibility you will concede to me in return for how much I may 
legitimately claim for a more definite assertion, we can get down to business. In terms of what 
we now call confidence intervals the argument proceeds as a public symposium in which the 
possibility of concord is contingent on an accepted framework of precisely specified fallibility. 

The development of the theory is largely due to J. Neyman. In retrospect, and for reasons 
given іп 16.05, Gosset’s pioneer paper on the /-distribution has a special interest in connexion 
with its beginnings, because it opened the door to an exact method of estimation of the mean 
of a normal universe ; and it is reasonable to suppose that a premonition of its relevance from 
that viewpoint motivated Fisher’s appreciation of its importance before it gained recognition. 
Credit for what is seemingly the earliest explicit statement of the common sense of the confidence 
approach in the taxonomic domain is due to Wilson (1927). Since Wilson’s contribution has 
received very little recognition, it will not be out of place to quote his words : 

In 1927 I called attention to the fact that many statements about probability are highly 
elliptical and illustrated the matter by the simple case of a point-binomial universe with unknown 
probability р and observed value p, in some sample. Using the admittedly rough estimate of 
probability based on the standard deviation one ordinarily writes 


Po — AV Pagol < P < Po + AV Patol 
and states that the probability that the true value р in the universe lies between the limits given 
may be had from a probability-integral table entered with a normal deviation of A units. I urged 


* Kendall's (1946) remarks (Advanced Theory of Statistics, Vol. II, p. 2) are eminently quotable in this context : 

“ It will clarify our ideas considerably if we draw a distinction between the method or rule of estimation, 
which, following Pitman, we shall call an Estimator, and the value to which it gives rise in particular cases, 
the Estimate, The distinction is the same as that between a function f(x), regarded as defined for a range 
of the variable x, and the particular value which the function assumes, say f(a), for a specified value of x equal 
to a. Our problem is not to find estimates, but to find Estimators. We do not reject a method because it 
gives a bad result in a particular case (in the sense that the estimate differs materially from the true value). 
We should only reject it if it gave bad results in the long run, that is to say, if the population of possible values 
of the estimator were seriously discrepant with the value of 0. The merit of the estimator is judged by the 
population of estimates to which it gives rise. It is itself a random variable and has a distribution to which 
we shall frequently have occasion to refer.” 

"The reader will note that the best estimator so defined is not a number, but a rule which would lead us to find a 
number in the most economical and reliable way, if consistently followed. 
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that a better procedure would be to use for the standard deviation the value pg/n obtained from 
the unknown р of the universe which leads to 


Pott Vist TOA, Pott | Урааа 
1+t 1-ct 1+t 1+t 


(Proc. Nat. Acad. Sci., Vol. 42, 1942) 


We have touched on the elements of confidence theory in Chapter 5 of Vol. I; but it will 
not be redundant to retrace our steps, if only to emphasise a nicety of definition. In conformity 
with the usage of the founding fathers of the theory of probability, many statisticians prefer to 
restrict the term probability in a practical sense to denote the long-run frequency of an external 
occurrence in contradistinction to the long-run frequency of a correct judgment concerning 
such an occurrence. If so confidence is not probability. From a behaviouristic viewpoint, 
however, there is no obvious objection to the use of the same term for the frequency of events 
which respectively do or do not involve human behaviour at the verbal level, if we make the 
distinction explicit when appropriate, recognising in what situations it is so. When we take 
a sample from a homogeneous universe, the parameter (p) concerning which we seek an estimate 
has a unique value, the probability of which in any meaningful sense is unity. Thus we can 
speak with propriety of p as the probability that it actually lies within those limits if, and only 
if p has one of two values, viz. : p = О or p = 1; but we may state with propriety, and without 
any such restriction, that p is the probability of a correct assertion about limits between which 
it lies. The probability of making a correct assertion by consistent application of a rule, and 
that is what we here mean by confidence, may indeed have any value between 0 and 1 in conformity 
with the way in which we define the limits our assertion sets to the values p may take. 

It will be easy to get into focus the formal implications of this distinction, if we examine 
artificial situations for which we can construct a model game-of-chance. Those which follow 
in this section prescribe a homogeneous universe concerning which we seek to estimate some 
single definitive parameter. 

Model Ia. We shall conceive that a lottery wheel has 1024 sectors labelled with scores 
x, (x + 1), (x + 2), (x +3)... (x + 9), (x + 10) respectively allocated to 1, 10, 45, 120, 210, 
252, 210, 120, 45, 10, 1 sectors. So much we know ; but we do not know the numerical value 
of x itself. At each spin we record as our score that of the sector opposite a fixed pointer. We 
now suppose that we spin the wheel 40 times and record the mean score (М,) of the 40-fold 
sample as 6:3. Our problem is to define what we can legitimately assert about x. 

The long-run mean value (M) of the score of any sample is, of course, (x + 5); and the 
terms of (1 + 3)" define the u.s.d. of the universe with variance o? = 2:5, whence that of the 
distribution of the 40-fold sample mean is 

ot | 
on = 20—16 
Thus om = 0-25; and the error involved in a normal quadrature for the distribution of the 
sample means is trivial. We can thus say that 


(а) the mean (M,) of 2:5 per cent. of all samples in the long run will exceed 
М + 20, = M +05; 
(b) the mean of 2-5 per cent. of all samples in the long run will be less than 
M — 20, = M —05; 
(с) the mean of 95 per cent. of all samples will lie in the range M + 20, = M + 0:5. 
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To say of 2-5 per cent. of all samples that M, > M + 2c,, is to say of 2-5 per cent. of all 
samples that М, — 2c,, > М, in which event M < M, — 0-5. To say of 2-5 per cent. of all 
samples that M, < M — 20,, is to say of 2:5 per cent. of all samples that M, + 20m < M, 
in which event M > M, + 20„. The assertion that the sample value (М,) lies within the range 
М + 20,, will be true of 95 per cent. of all samples, i.e. the probability that it is true is 0:95. 
Since such an assertion is formally identical with the statement that M itself lies within the 
range М, + 20, we can assign a probability of 0-95 (95 per cent. confidence level) to the truth 
of the assertion that M lies within the range 6:3 + 0:5, i.e. from 5-8 to 6-8 inclusive. Since 
M — x +5 by definition, we can say with equal confidence that x itself lies within the range 
0-8 to 1-8 inclusive, assigning 1 as the correct value (at the 95 per cent. confidence level), if x 
is an integer. 


A CONFIDENCE MODEL 


25% sample values of M lie 
above theling My = M+ 2m. 


Of all such samples it is true that: 
Mz > M*20,. 


«For all values ої M above the 
line M € Mx-20,. 


25% sample values of Mx lie 

below the line Mz M-20,. 

Of all such samples it is true that: 
My M-20 

For all values of M in this region 
M 7My*206,. 


95% sample values of Mx lie on 
or between the lines 

Mz =M 20. 
For all values of M in this region 
Ma*26, > M >My-20,, 


Ц 1 
Mz63-20, M=63+20,, 
=58 =68 
xX:O8 x8 


Fic. 137. The Region of Confidence for the lottery wheel model of p. 888. 
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We can set out the above reasoning in tabular form thus : 


Event Probability of Probability of 
its occurrence Equivalent assertion its truth 
M, > M+ 20m 0-025 M « M, — 20m 0-025 
M, < M — 20n 0-025 М > M, + 20m 0:025 
M—20m<M,<M+2c, 095 М, +20, > М> М, — 20 095 


Fig. 137 exhibits the argument based on our lottery wheel model within the range of values 
5 <M <9апі0 <x «4. For any value of M we deny the occurrence of all values of M, 
greater than M + 20m or less than M — 2o,, with a probability of erroneous assertion approxim- 
ately equal to 0-05. Thus 95 per cent. of all sample values of M, will lie within the two parallel 
lines M, = M + 2c, and M, = M — 20. There will correspond to any observed value 
of M, two values of M where the line through M, parallel to the abscissa cuts these two lines. 
"These two values will define the range of M consistent with the probability of error assigned 
to our denial of the limits of admissible values of M,. 

In one respect, the foregoing model is highly artificial, i.e. we know in advance the numerical 
value of the variance (ø) of the u.s.d. and hence that of om. When sampling from a putatively 
normal universe we rarely, if ever, have such knowledge ; but we do know the distribution of 
the ratio (М, — M) to the unbiased sample estimate (Sm) of сь. Hence as explained in 16.09 
we can get from the ¢-table upper and lower limits for M consistent with any assigned probability 
of erroneous statement within the framework of repeated application of the rule. We can do 
the same for o? itself by recourse to tables of the Chi-Square distribution as explained in 16.03. 

Model Ib. We now suppose that our lottery wheel has 100 sectors on each of which the 
number of pips is either 0 or 1. We do not know the number (100g) of sectors which carry 
no pips or of sectors 100p = 100(1 — q) which carry one pip. We spin it 100 times and record 
the mean score of the 100-fold spin as 0.62. Our problem is to define confidence limits of 
р, the proportion of sectors which carry one pip. We are here sampling in an infinite two-class 
universe, and successive terms of (q + p)™ define the frequencies of the observed proportionate 
(mean) score p, = 0, 0-01, 0-02, 0:03, . . . 0-99, 1:0. "Тһе unknown variance of the distribution 
of р, is given by 


Throughout the range of prescribed values other than p = 0 or р = 1 the distribution 
of the observed proportionate score will be approximately normal. The range р, = p + 20 
will therefore define the 95 per cent. confidence level well enough for heuristic purposes. Since 
c, depends on p, being zero when р = 0 or р = 1, the two boundaries of acceptable values 
of р, will not be parallel straight lines as in Fig. 137. They will meet at p = 0 and p= 1, 
the upper being concave downwards, the lower being concave upwards. The corresponding 
acceptable range of p values for any observed value of p, is obtainable graphically (Fig. 138), 
as before, by drawing a horizontal line to parallel the abscissa ; but each limit is subsumed by 
the two roots of the quadratic 
(р, — py = 403 = 22. 


If the observed mean value is 0-62 this becomes 


25(0-62 — p)? = p(1 — p), 
=. 26p? — 32р + 9:61 = 0, 
s pœ052 ог 071. 


SECOND THOUGHTS ON SIGNIFICANCE 891 


CONFIDENCE IN THE DOMAIN OF THE 
2-CLASS UNIVERSE 
Op = >а ; г=100. 


Observed Proportionate Score (po) 


Ol ог OS оз OS O6 OF ов OF tO 
True value of p 


p = CPot2)+ Jepet) -rlr +a)pa 
г+4 
£2 0:66 or O-83 
Fic. 138. Graphical Interpretation of the Quadratic Solution of Confidence Limits in the Taxonomic 


domain, 


At the 2c confidence level we shall therefore say that our lottery wheel has no more ап 71 
and no less than 52 sectors carrying one pip. There is no need to generalise this case, already 
dealt with in Chapter 5 of Vol. I. Four points call for comment : 


(i) the foregoing method is valid only if we can assume that the normal curves give a 
good quadrature for the binomial distribution, the relevant condition being as stated 
in 14.07; 


(ii) even so, we can assign the appropriate confidence level correctly only if we pay attention 
to the half interval correction ; 
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(iii) if the size of the sample is small we can define, for any value of p, limits which exclude 
at least 2-5 per cent. (or other agreed figure) at either end of the range by recourse 
to the tables of the binomial ; * 


(iv) if the size of the sample is large, a very small observed value of p, may suggest that 
the Poisson distribution gives a better summation of terms than the normal integral. 


Model Ic. It limits our horizon unduly, if we confine our interpretation of confidence 
limits to situations in which we can assume without appreciable error that our score distribution 
is approximately normal and the confidence interval itself expressible in terms of its variance. 
The latter has no relevance when the universe is rectangular; and we may therefore deepen 
our insight into the logic of confidence theory, if we now lay aside any preoccupations with 
the normal distribution. As an elementary example of the confidence approach to estimation 
in the rectangular universe, we may consider the following model. A lottery wheel has s sectors 
with consecutive scores from 1 to s, so that the proportion of sectors whose score value (x) exceeds 
m(«s)is(s — т) = s. We shall suppose that we spin it once and record х. Our first problem 
will be: what can we legitimately say about s ? 

In the treatment of the foregoing model we have side-stepped a limitation of interval estima- 
tion in the domain of discrete score values by assuming a good enough normal fit. Unless we 
postulate a continuous distribution we cannot in fact assign an uncertainty safeguard (Р, = «) 
or confidence level (1 — Р,) = (1 — х) to an admissible range of score values. The best we 
can assert is a statement of the form P, < « or P, < «, as when we use tables of the binomial 
in the situation of Model I (b). One reason for this is that we can assign more than one value 
to m consistent with a fixed value P, = « for the rule to disregard all samples if x >m. If the 
score x is an integer, e.g. k or (k + 1), we can postulate an infinitude of values to which we can 
assign the probability « that x > m in the range k < m < k + 1. 

It will be convenient to write P(x > А) for the probability that x exceeds k and Р(х > k) 
= P(x >k — 1) for the probability that x is not less than k. If k is an integer there are (s — k) 
score values in the range x > k and (s — k + 1) in the range x >k, whence 


—k s—kil 


P(x > № = and Ра >= =E . . . 


If k +1 >m > Ё зо that m is either an improper fraction in the interval between А and (k 4-1) 
or is the integer & itself, we may write m = (k + є) and k = (m — :9 for values of є in the range 
O<e <1. When є = 0, we may write 


Р(х > т) = and P(x > т) = женк, 


When є>0 
s—k s—m--e 


P(x > т) = P(x > k) i ; 


$ 


Р(х >т) P(x >В) LL == 


Р(х> m) *— 


and Р(х >m) > 


s—m+1 25 
ast (ii) 


* Tables of the Binomial Probability Distribution, 1950. National Bureau of Standards, Applied Mathematics 
Series, 6, Washington; Clopper and Pearson (1934), Biometrika, Vol. 26. 


SECOND THOUGHTS ON SIGNIFICANCE 893 


We may subsume both equations (i) and (ii) to cover the possibility that m may or may not 
be a whole number in the expressions 
= mv 
P(x > m) > and Р(х > т) >=" 
Let us now set m = as, so that 
Rule (i): P(x> оз) >1— 2; 
Rule (ii): Р(х >as) >(1— a) + 1> (1 — a). 
The proportion of all samples whose score x exceeds «s is thus no less than 100(1 — х) per cent. ; 


and the proportion of all samples whose score x is not less than «s is greater than 100(1 — «) 
per cent. We may set out the implications of the foregoing statements as below : 


Есет Probability of Equivalent Probability of Probability of 
i its occurrence assertion its truth its falsehood 

x> as > (1-9) d P, > (1 —2) Poza 

x>as > (1-2) е; P,>(i—2) Р, <o 


We may express this by saying that our uncertainty safeguard for the assertion that s is less 
than 20x does not exceed 5 per cent. and our uncertainty safeguard for the assertion that s is 
at least 20x is less than 5 per cent. On the basis of observations of a single spin with scores 
respectively x — 5 and x — 10, our assertions would thus take the following form, if we deem 
P, « x as an acceptable level of uncertainty : 


x=5 x= 10 P, 
Rule (i) A * . s «100 s < 200 < 0:05 
Rule (ii) . Я z s < 101 s « 201 «005 


To say that s < 100 in this context is to say that the upper confidence limit is 99. In terms of 
confidence limits we therefore write the above as 


Upper Confidence Limit of s 


DIEA x=10 P, 
Rule (i) . E < 99 199 < 0:05 
Rule (ii) . . . 100 200 < 005 


Why we cannot express our confidence level in the form of an exact specification of the 
uncertainty safeguard of the form P, = « will be clear if we state the foregoing rules in another 
way. In effect, rule (i) signifies that we propose to disregard all samples if x < «s and rule (ii) 
that we shall consistently disregard samples if x < zs. We can get a backstage view of their 
implications, if we determine the proportion of excluded samples, i.e. the true uncertainty 
safeguard prescribed by each rule for values of s in the neighbourhood of 200, when « = 0-05 
defines the upper limit of acceptability for our uncertainty safeguard and the sample score is 
x= 10, For s = 199, 200 and 201 respectively zs = 9-95, 10 and 10-05. By rule (i) we dis- 
regard samples whose scores are 9, 10 and 10. The exact probabilities (P,) of doing so are 
respectively 

3b s Ай. 


К УМ 
199 » 
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By rule (ii) we disregard samples whose scores are 9, 9 and 10 with probabilities 


тёз: Boo 5 or 
'Thus the values of P, for s in the neighbourhood of 200 are 
s Rule (i) Rule (ü) 
199 = 0-045 œ 0:045 
200 = 0-05 œ 0-045 
201 = 0-0497 => 0:0497 


Rule (i) will make P, = 0-05 = х when s is an exact multiple of 20 = «1; but otherwise 
P, < о. Rule (ii) makes P, nearly equal to « when s is an exact multiple of 20 but always less 
than ж. 

The fatal fascination of the continuum to the theoreticians of statistics arises from the 
circumstance that such inequalities do not trouble us; and it is instructive to examine the 
consequences of invoking the continuous rectangular variate in this situation. To define a 
rectangular distribution as a continuous variate we have to satisfy two conditions: (a) the 
probability f(x)dx that a score lies in the range x + }dx is constant for all values of х, i.e. 
f(x)dx = K.dx; (Б) the complete integral is numerically equal to unity, i.e. 


K| a-1- &e- 0. 
1 


The probabilities that the score lies in the range from 1 to & or k to s are then exactly 
1 k k—1 
Р(х <= jr 
1 "n s—k 
Р(х >№= |7 


We cannot split a range of whole number score values from 1 to s into two regions х < k 
and x >k as we can if x is a continuous variate; but we can often get a good approximation 
to a sum by integration if we invoke the half interval correction. We then interpret x > to 


mean x > (А + 3), so that 
Pe» Ba emo 


eb s—1" 
2s —2k—1 
ve DS) c o mS 
To make P(x > А) = 1 — a, we have 
2k—1 
е2 m and k-—o(s— 1)-- 3. 
The statement х > «(s — 2) + 3 is equivalent to 
pub e 
a 


If « = 0-05, this is equivalent to s < (20x — 9); and when x = 10, s < 191 with P, = 0:05. 
The value of « consistent with x = 10 and s = 191 prescribed by rule (i) above is « = 10 + 191 
= 0:0523 ; and the rule states that Р, < о, i.e. Р, < 0-0523. 
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We did not have to face the issue last discussed in the context of Model I (5), because we 
invoked a normal approximation for the summation of the terms of a truly discrete binomial 
sample distribution. It is therefore instructive to re-examine the foregoing model situation on 
the assumption that the score x is a continuous rectangular variate. We may then interpret 
x > kas x > (k — 3) and x < k as x < (k + }). To accommodate all discrete values in the 
range x = 1 to x = s inclusive we must accordingly extend the range of the continuous distribu- 
tion from x = }tox = (s + 3). On this understanding, our formal definition of the continuous 
rectangular distribution has merely to satisfy two conditions: (a) the probability f(x)dx that a 
score lies in the range x + 4dx is constant for all values of x, ie. f(x)dx = K.dx: (b) the 
complete integral is numerically equal to unity, i.e. 


"i 1 
к| dx = 1 = Ks and К=-. 
i 


The probabilities that the score lies in the range from 1 to & or beyond Ё are then expressible as 
ашы k k 
Pe <4) =+| a and Р(х > в) =1— 5. 
+ 


The above statement is exactly true of the discrete distribution, since Р(х < А) = Р(х < k +4) 
if x is necessarily an integer. In effect, we make our range from JAx to s + 3Ax, since Ах = 1; 
and we may neglect Ax if s is very large, as we must assume if we invoke the continuous distribu- 
tion as a descriptive device. We shall then say that the range is from 0 to s, and admit fractional 
values of x consistent with the specification 


o k 
Pee >) = 2)" a= 


Accordingly, we now proceed on the assumption that x can have any real value in the range 0 to s. 
To make P(x > А) = 1 — « we then put k = sz, so that 


P(x > зх) —1— a. 


Within the framework of the rule implicit in the procedure, we then assign (1 — х) as the 
probability of correctly asserting 


x 
s<- 
a 


When « = 0-05, this is equivalent to assigning P, = 0-05 to the assertion that s lies within the 
range from 1 to 20x. 

We have hitherto confined our attention to a procedure which entitles us to assign to s an 
upper confidence limit with an uncertainty safeguard P, < «. If we wish to place it with a 
preassigned uncertainty safeguard in an interval ax > s > bx, the form of statement we may 
make is no longer unique. If we may justifiably proceed on the assumption that we can assign 
an exact uncertainty safeguard P, = y to what assertions we do make within the framework of a 
prescribed rule of procedure, i.e. that we may legitimately rely as above on the continuous 
distribution, we may write 
m—k 

zs 


1(™ 
Pie <x<m)=+| dx = 
k 
If we now write k = fs and m = as 
P(Bs < x < as) = a — В. 
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We then assign an uncertainty safeguard P, — 1 — (x — B) to the assertion 
e 
B 
If B = 0-025 and « = 0-975 so that P, = 0-05 our final statement will thus be 


x 
>$>-. 
СА 


40x > ғ > E 
Now Р, = 0-05 if B = 0-01 and х = 0-96. We are therefore entitled to assign P, = 0-05 as 
the uncertainty safeguard to the alternative assertion 


25x 
100x > s > 24" 

When we write P(x > sz) = 1 — x or P(Bs < x < as) = x — B, we state the probability 
of an event, ie. value of unit score x, within the framework of the classical theory of 
probability and the convenient fiction that the distribution is continuous. Our assertion 
signifies : for the fixed value s of the relevant parameter, P,., is the probability that the unit 
score will lie in such and such a range. We have refrained from writing the probability we 
assign to the equivalent assertions in the notation 


P(s«x«)—1—« or P(fbx2s2ax)-—«—B 


lest we should hastily interpret them in terms of inverse probability, і.е. as if we could 
legitimately say : for the fixed value x of the unit score, P,., is the probability that s will lie in 
the specified range. Such a form of words is inconsistent with Neyman's theory. We must 
interpret a statement in the form P(ax > s > bx) = y as a summary of the long-run result of 
consistently adopting one and the same rule of conduct regardless of the value (e.g. x — 5) the 
score x may have in any single trial, including the particular trial to which our specification of 
the interval estimate is referable. The formal statement of the rule will be adequate only if it 
explicitly specifies x as an unknown which may assume any value within its admissible range. 
We misinterpret it if we condense our verdict in such a form as 


200 
P(200 >s> =) = 0:95. 


This is an act of self deception into which we easily slide, if we write the formal indentities : 
B(h + dh) = x = ch; 


x x B &.dh . 

h hdi ^ ^ — Mh dh) 
x. dh 

P(h 4 й>з>һу= 0. 


We have now eliminated any reference to x as a variable in the expression on the left and have 
obtained on the right what is seemingly the element of a probability distribution and satisfies 
the fundamental property of the latter, if we fix x and define the range of s from h = x toh = œ, 
so that 

© 
«| h-*.dh = 1. 


z 


E 
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This step, which leads to what Fisher calls a fiducial probability distribution, is admissible 
only if we can legitimately confine our statements to situations in which x has one and the same 
value (e.g. x = 5). We could then write 


k 2А, 
Ре] вав, 


If k = 20x, we thus obtain by a somewhat circuitous route а result already derived within 
the framework of the assumed continuous rectangular distribution, i.e. P(s < 20x) = 0-95. 
The numerical consistency of many—though not all—results embodied in Fisher’s approach to 
interval estimation with those to which the theory of confidence limits leads us did indeed at one 
time blind many statisticians to what we now see to be a radical difference. If we conceive 
æ . f (h)dh as an element of a probability distribution, we have to regard л and x as independent 
to arrive at a numerical result consistent with confidence theory in the continuous domain ; but 
we can do so only if we then treat x as a constant in the algebraic manipulation. We thus 
implicitly fix our interval in terms of a preassigned value of x to arrive at the specification of a 
probability dependent thereon; but this is inconsistent with the programme of Neyman's 
theory which specifies the interval in terms of a preassigned probability independent of the 
outcome of any single trial and hence of any preassigned value of x. 

We come to a parting of the ways, when we ask questions involving joint distributions, such 
as that of the so-called Behrens test invoked to estimate the difference between the means of 
different normal universes. In the confidence theory of interval estimation, we must first 
specify the composite distribution of relevant composite score values referable to all possible 
values of each variate, e.g. that of the r-fold sample mean difference d, , referable to all possible 
values the sample means (M, , and М, ‚) may assume. The prescription of the Fisher 
school derives a composite fiducial distribution from the particular fiducial distributions of 
Ma., and M, Unless the variances с, and o,? of the parent unit sample distributions are 
equal, the two procedures lead to different results ; and this has provoked a lively controversy 
conducted with an output of heat disproportionate to the illumination conferred.* 


20.07 ESTIMATION AND THE Bayes’ DILEMMA 


We have hitherto regarded the problem of estimation as that of assigning a probability to the 
truth of the assertion that some definitive parameter of a homogeneous universe lies between speci- 
fied limits. So stated, the issue sidesteps the disquieting dilemma with which the balance sheet 
of Bayes confronts us. Bayes’ theorem is essentially about a stratified (heterogeneous) universe, 
e.g. a bag in which some pennies are unbiased and one penny (through a defect of minting) 
has the King’s head on both sides. In effect, it says: to know how often I should be right 
in judging a coin taken from the bag as the one defective coin after getting 10 successive heads 
in a single 10-fold toss, I must also know how many other coins the bag contains. The dilemma 
to which the theorem draws attention is that we rarely have such knowledge ; but it is one which 
the theory of confidence sidesteps. The confidence theory of interval estimation deals with 
a Bernoullian universe, e.g. a bag containing pennies all of the same sort; and formulates 
how much we can say with propriety about the behaviour of such pennies on the basis of a 
single 10-fold sample. As we have seen, it relinquishes the attempt to assign a so-called best 
value for the long-run frequency (p) of heads as the result of tossing any one of them in pre- 
ference to an exact statement in terms such as the following: though I cannot say what is the 


* Behrens, W. V. (1929), Landw. Jb., 68, 807. Fisher, R. A. (1935), Ann. Eug. Lond. 6, 391. Sukhatme, P. V. 
(1938), Sankhya, 4, 39, Neyman, J. (1941), Biometrika, 32, 128. 
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correct or best value of p, I can tell you within what limits p will lie if you will agree to let me 
be wrong not more than aN times (e.g. 0-05) in N trials when N is very large. It is the writer’s 
belief that Neyman (1934) does not overstate the novelty or the importance of the viewpoint 
explored in 20.06 when he declares : 

The solution of the problem which I described as confidence intervals has been sought by 
the greatest minds since the work of Bayes 150 years ago. Any recent book on the theory of 
probability includes large sections concerning this problem. The present solution means, I think, 
not less than a revolution in the theory of statistics —(ў. Roy. Stat. Soc., Vol. 97, р. 536.) 

We shall now examine model situations which suggests an alternative more sophisticated 
approach to the problem of confidence to clarify what is common to the domain of decision tests 
and the domain of estimation. It is also of special interest for another reason mentioned at the 
end of 20.03 above. Till recently, it has been common to assume that an adequate theory of 
statistical decision must come to terms with the prior probabilities of Bayes’ theorem. This 
belief leads to an impasse unless we are content to embrace the highly exceptionable postulate 
mentioned in 20.03 ; but it rests on a debatable assumption that the model situation with which 
Bayes’ theorem deals is factually relevant to statistical decisions involving no more than one 
hypothesis referable to an existent population at risk. We can best see the irrelevance of the 
theorem to the issue of estimation if we: (a) provisionally postulate a model situation to which 
it is indeed factually relevant ; (b) formulate a procedure which is valid for all conceivable values 
of the prior probabilities and therefore to the limiting case when there is only one urn. The 
universe of our models of this section will be a stratified universe, and our problem to attach 
an acceptable uncertainty safeguard to the assertion that a parameter definitive of the single 
stratum from which we take a particular sample lies within a specified range. 

Model IIa. With this end in view we shall suppose that someone spins 40 times one of 
100 lottery wheels chosen at random. Each such wheel has 1024 sectors like the wheel of our 
first model in 20.06 with scores of x, x + 1, (x + 2), . . . (x + 9), (x + 10), allocated respec- 
tively to 1, 10, 45, . . . 10, 1 sectors. The recorded score of the 40-fold spin is again 6-3, 
and we do not know the value of x associated with the particular wheel selected for the spin. 
We do know, however, that each wheel is one of eleven types as follows : 


Type No. of wheels Value of x 
I 1 05 
II 3 0-6 
ш 10 07 
IV 17 0-8 
N. 20 11 
VI 7 13 
VII 12 15 
VIII 3 1:8 
ІХ 8 19 
X 2 20 
XI 17 21 


In this model set-up, we may construct 11 admissible hypotheses about the value of x, 
and hence of the expected mean М = (x + 5). For each hypothesis the standard deviation 
of the distribution of the observed mean (M,) of the 40-fold spin is om = 0-25, and to each 
hypothesis we can assign a prior probability in Bayes’ sense. From this point of view, the 
relevant information is as follows : 
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Hypothesis Prior Probability M (M — M,) + e 
I 0-01 55 a2 
п 0-08 56 —28 
IH 0-10 57 —24 
IV 0-17 58 — 20 
у 0-20 61 —08 
VI 0-07 63 0 
VII 012 65 +08 
уш 0-08 68 +20 
IX 0-08 69 4-24 
X 0-02 70 +28 
XI 0-17 71 +32 


We shall now make in the following гше. We shall reject some hypotheses as inadmiss- 
ible and reserve judgment on others which we shall accordingly regard as admissible, applying 
to each hypothesis the same criterion of rejection, i.e. that it assigns to the deviation of the 
observed score (M, = 6:3) from the expected value (M) prescribed by the particular hypothesis 
a value numerically greater than 2c,,. We then reject all hypotheses except IV-VIII inclusive, 
and are left with the assertion that M lies in the range 5:8-6:8 corresponding to values of x from 
0:8 to 1:8. 

Our uncertainty safeguard for rejection of every hypothesis when true is 0-05 since our 
rejection criterion is modular. That the unconditional uncertainty safeguard for the final 
verdict is also 0-05 as for Model Ia, we may make explicit as follows. We first remind ourselves 
that we can falsely reject only one hypothesis, since only one can be true. "Thus the uncondi- 

* tional probability of a false verdict is the unconditional probability of falsely rejecting one or 
other of an exclusive set of hypotheses, and is therefore obtainable by recourse to the addition 
rule. If P,isthe prior probability that the particular hypothesis H is applicable to the 
situation, ie. that we chose at random a wheel of type H to spin, the probability of falsely 
rejecting it is «Р„; and by definition 


The probability of making a false decision is the probability of falsely rejecting any one of the 
hypotheses, i.e. 


A21 ERU 
> Р.а = 9 m Bm 
hel hel 


Thus « is our uncertainty safeguard to the assertion that M, lies within the prescribed limits ; 
and the prior probabilities of Bayes do not affect its value. We arrive at exactly the same result 
as for the corresponding situation (Model la) of 20.06, where we set the same uncertainty 
safeguard to the same range of admissible values of the parameter x of ome and the same 
wheel. 

Should the reader find the last step of this argument difficult to follow, it may be helpful 
to set it out in the form of a truth table for which it will suffice to predicate only 4 hypotheses 
with prior probabilities Р,, Р,, Pa, Р, and corresponding definitive parameters M,, М,, etc. 
Each hypothesis corresponds to a fictitious possible universe, which is a wheel of a given type 
in our model situation. The hypothesis we deem to be applicable to the situation is the actual 

16 
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universe from which our sample comes, i.e. the particular wheel of which we record the outcome 
of a 40-fold spin. We may then set out the procedure in stages as follows : 


Prior Probability of Probability of Rejection as such Probability of Retention as possibly such 
choosing the wheel (a) (1 — a) 
P, Py P,(1 — о) 
P, Ре Pj — а) 
P, Pya | РДІ — a) 
P, Pe P( — а) 
"Total ӘР, + Pa +P, +P) = а (1 — a) (P, + P + P, + P) = (1 — a) 


In this table each cell entry of the second column records the probability that we shall both 
choose a particular wheel to spin and reject the conclusion that we have done so. Each cell entry 
on the right records the probability that we suspend judgment. The grand total of all the 
cell entries is а + (1 — «) = 1. Thus our decisions are classifiable exclusively and exhaustively 
as either definitely false or uncertain, and we may interpret our balance alternatively in terms 
of probabilities assignable to our decisions as follows : 


Decision 
Hypothesis 
False Non-committal 

I Pye |: eee | —a) 

II Ру | ra- | — a) 

ш Рул Е | —a) 

Iv ва | Pa ME C РАІ а) 
"Total ЕГ a | -a 


In the set-up of this Model, we regard any one of a limitless number of values p may have 
as a hypothesis referable to a conceivably, but not necessarily, existent population at risk. We 
thus interpret the process of estimation as a method of screening an exhaustive set of hypotheses 
as admissible or otherwise by successively applying to each a test prescribing the same probability 
of rejection if the hypothesis is indeed true. Our universe of hypotheses so conceived is a strati- 
fied universe, in which strata with the same definitive parameter P, provisionally constitute 
an existent population at risk with an assignable finite prior probability in the jargon of Bayes’ 
theorem. Bayes’ prior probabilities (P,) are then relevant to the initial formulation of the 
problem ; but they do not appear in the solution. Consequently, we are free to assign to the 
prior probability of any single hypothesis any value in the range 0 to 1 consistent with the 
restriction that the sum of all the prior probabilities is unity. Whether there corresponds an 
existent population to a particular hypothesis in our fictitious stratified universe is therefore 
immaterial, That a particular hypothesis to which we apply the test corresponds to no existent 
population merely means that P, =0. To conceive the universe as unstratified is to assign 
Р, = 1 to one stratum and Р, = 0 to every other one. In this sense, Model I is therefore a 
limiting case of Model II. 
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This way of looking at the problem of estimation makes the distinction between the domain 
of test decision and that of estimation less clear-cut than the alternative ; but we should not lose 
sight of what remains. If we perform a decision test to arbitrate simultaneously on the merits 
of alternative hypotheses which constitute an exhaustive set our rejection criterion or criteria 
determines which we accept and which we reject ; and we can never assign the same probability 
of rejection if true to more than 3 hypotheses on this understanding. If we interpret the procedure 
of estimation in terms of the model of this section, we can regard it as the performance of a 
battery of tests, but the score value which defines the criterion of rejection is different for each 
test and the decision to reject any one hypothesis or group of hypotheses does not prescribe 
acceptance of any other single hypothesis. We successively apply to each a test involving a new 
value of the score deviation (x — M) as the criterion which ensures the same probability of 
rejection for each hypothesis when true. If we assert that one group of hypotheses constitute 
an admissible in contradistinction to a residual group as an inadmissible set, we then do so on 
the assumption that one of the former is identifiable with the correct one. 

Model II (с). In the homogeneous universe of Model I, we have seen that we can set an 
upper limit (P, < æ or P, < х) to the uncertainty safeguard we attach to a confidence boundary 
in the domain of discrete score values; but we cannot make an exact statement of the form 
P,— x. Let us now therefore look at the problem raised by Model I (c) of 20.06 as one of 
sampling in a stratified universe. We shall postulate as below an assemblage of 100 lottery 
wheels of 12 types with consecutive scores 1 to т inclusive if s = m is the number of sectors 
of a wheel of type H. Thus we have 12 hypotheses about s to explore, each referable to an 
existent population at risk ; and we shall once more limit our decisions to rejection and reservation 
ofjudgment. We know the score x of a single spin without knowing the type of wheel to which 
itis referable. Our problem will be to assign a probability to an admissible set of hypotheses. 


Type of Prior Probability 
Wheel No. of Sectors No. of Corresponding of Choice 
(H) (sa) Wheels (N,) (P, = №, + 100) 
i 5 13 0-13 
2 19 2 0-02 
3 20 1 0-01 
4 21 3 0-03 
5 39 7 0-07 
6 40 12 0-12 
7 99 3 0-03 
8 100 4 0-04 
9 101 9 0-09 
10 199 10 0-10 
11 200 15 0-15 
12 201 21 0-21 
"Total 100 1:00 


For Model I (c) we formulated two rules 


Rule (i) s <* with P, <a; 
a 


E LIS 
16* Rule (ii) s == with P, < a. 
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In effect, the first rule states that we reject the hypothesis s = s, unless x > as, ; and the second 
- States that we reject the hypothesis s = s, unless x > озу. "Thus our rejection criteria are 

Rule (i) Reject if x <as with P, <a; 

Rule (ii) Reject if x < as with P,— a. 
As below, we may then draw up a table of verdicts based on each of the foregoing rules 


for different experiments in which x — 5 and x — 10 respectively. In each case we assume 
that « = 0:05 is an acceptable level of uncertainty. 


| Hypothesis | No of Criterion E SU 
(h) (ss) (xs, = 005s) | Verdict by Verdict by Verdict by Verdict by 
Rule (i) | RueGi) Rule (i) Rule (ii) 
1 5 0:25 Open Open Open Open 
2 19 0:95 Open Open Open Open 
3 20 1:00 Open Open Open Open 
4 Ee. 1:05 Open Open Open Open 
5 39 1:95 Open Omm Open Open 
6 40 2.00 Ореп Ореп Ореп Ореп 
7 99 4:95 Open Open Open Open 
8 100 5:00 REJECT бкл =. Ореп 
9 101 505 REJECT REJECT Open Open 
10 199 9-95 REJECT REJECT | Open Open 
11 200 10-00 REJECT REJECT REJECT Open 
12 201 10-05 REJECT REJECT REJECT REJECT 


"The range of s values covered by open verdicts thus corresponds precisely with the outcome 
of our examination of Model I (c) for which the upper confidence limits are 99 and 199 respec- 
tively for x = 5 and x = 10 with P, < 0:05 (Rule i) or 100 and 200 respectively for х = 5 and 
x= 10 with P, < 0-05 (Rule ii. The meaning of the correspondence is evident if we recall 
the meaning of the true conditional uncertainty safeguard (P, . ,) of hypothesis H in the domain 
of discrete score values. If our criterion of rejection is x < xs, we exclude only samples whose 
score value is x = s when «s itself is an integer. Thus Р, ;, the proportion of excluded score 
values when hypothesis H is true, is the ratio to s of the nearest integer not exceeding s and is 
always less than or equal to х. If 0 < e, < 1 we may thus write 


Pj4,— & — en 


һ=12 һ=1? һ=1? 


B= > PLI а БР Р,. гь 
h-1 h-1 h=1 
h-12 


v PE » Pr» er 


heal 
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Since we have chosen the rejection criterion so that Р, „ < x, all values of є, must be zero or 
positive. Rule (ii) asserts that they are all positive, whence we obtain as for Model I (с), 
P, «a. 

In this instance, some values of e, are positive when we apply Rule (i) and others zero. 
Thus P, < ж аз before; but this is not inconsistent with the assertion P < х being included 
therein. A generalised Model II situation must take stock of the possibility that Р, , = « 
for each wheel as would be true if we knew that the recorded score referred to a wheel of any 
one of types З, 6, 8, 11 above. For each of these Р, , = 0-05 and є, = 0 as will be seen by 
citing the values of P, „ prescribed by our rejection criterion, viz. : 


m аз, Rule (i) Rule (ii) 
5 0-25 0-0000 0:0000 
19 095 0:0000 00000 
20 1-00 0-0500 00000 
21 1:05 0-0476 0°0476 
39 1:95 i 0-0256 0-0256 
40 2:00 0-0500 0-0250 
99 495 0:0404 0:0404 
100 500 0-0500 0:0404 
101 5-05 0-0495 00495 
199 9-95 0:0452 0:0452 
200 10-00 0-0500 0:0450 
201 10-05 10-0497 0-0497 


In the treatment of Model I (с) we have already recognised one reason for regarding the 
concept of fiducial probability as an inadequate basis for a theory of statistical inference in that 
it restricts the field of discussion to continuous variates. Further consideration of the model 
situation we have last discussed gives us an opportunity for contrasting two theories of interval 
estimation from a different viewpoint. Fiducial probability takes its origin from assumptions 
common to the theory of confidence; but Neyman's development of the latter is inconsistent 
with Fisher's interpretation of the former, unless there is some sense in which only one admissible 
preassigned rule of test procedure is appropriate to one and the same situation. Models I (c) 
and П (c) do indeed refer to a situation in which only one such rule invites our attention as 
relevant to the end in view ; but we have not excluded the possibility that more than one might 
each have seemingly equal claims to commend it from a purely formal viewpoint. We shall 
now examine a situation in which this dilemma arises. 

Since the issue has special relevance to the concept of fiducial probability, we shall postulate 
a continuous rectangular distribution over the range } to s + 3, and examine what statements 
we may make when we draw two unit samples with scores x, and x, Two, though not the only 
two, rules which we may formulate will serve our purpose well enough for heuristic purposes. 
We shall alternatively seek to prescribe an upper confidence limit to s with an uncertainty 
safeguard « by recourse to 

(i) the maximum score x, being x, = x, ifa; > x, and Xm = x if x, > х; 

(ii) the score sum x; = x, + xs. 

The probability that x,, < m is the probability assignable to the joint occurrence that each 
score lies in the range from x = 0 to x = m inclusive, i.e. 


2 2 
Р(х, < т) = ^ and Р(х, >m)=1 -5r 
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We wish our final assertion to take the form s < kx with a probability (1 — «) of correct assertion 
if we consistently follow the test procedure, whence we write P(x,, > т) = (1 — a), 


m = 
ENSE and P(x, > sya) — 1 — a. 


Within the framework of this rule, we then assign « as the uncertainty safeguard to the assertion 


If we base our test procedure on х,, defined as above, the reader unfamiliar with the continuous 
rectangular distribution will find it helpful first to make a simple chessboard diagram of the 
2-fold discrete score-sum distribution. It is then evident that we may express the probability 
that хуз lies in the range 2 to & if x = 1 is the origin of the unit score distribution in two ways : 


Рх» > В) = Besa ee 


МЕ — 1) 


Qs? 


when k>s+1; 


Р(х > В) = 1— 


when k<s +1. 


For the continuous case we may represent our chessboard geometrically as a rectangle of area 
s? and the region in which all values x,. < k lie when А < s as a triangle of area 3&*. Since 
we wish to associate a probability (1 — х) near unity to the truth of the assertion s < А-1. x, 
our concern will be with the smaller value of k. For the continuous case we then write 

ki 


Pu >) = 1-55 


=1— 0, 


е Р(х > 5V22) = 1—a. 
Our second гше thus assigns « as the uncertainty safeguard to the assertion 


Xi2 


SS 
М2 


We thus have two rules which assign different values то the upper confidence limit of s at 
one and the same confidence level (1 — «). In the strictly behaviourist formulation of confidence 
theory by Neyman this involves an inconsistency only if both rules incorporate all the information 
about the unknown parameter the sample can supply. One rule may be better than another, 
if it incorporates more information ; but its use may have drawbacks which outweigh its merit 
on that account. In Fisher's theory of interval estimation no such freedom of choice is admiss- 
ible. The avowed intention of the concept of fiducial probability is to express the intensity 
of legitimate conviction referable to a particular sample. If so, only one rule can be right, 
namely the rule which invokes all the information the sample supplies. Fisher speaks of a 
statistic, i.e. sample score, which has this property, as the sufficient one. 

The two statistics x,, and ху; used in the foregoing situation will serve to illustrate what 
is and what is not a sufficient statistic in Fisher’s sense of the term, if we now consider x, and 
x, as unit samples from a discrete rectangular universe with a range of scores from 1 to s inclusive. 
In deriving a rule on the basis of either we have suppressed any explicit specification of x, and xy. 
If our chosen statistic is defective it can be so only for that reason. We shall therefore ask : 
have we lost anything by withholding such information? We may answer this by considering 
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the consequences of confining our attention in a sequence of trials to samples with some pre- 
assigned value of Xm Or xj». 

Let us first suppose that the preassigned value of x,, = 3. The different sorts of double 
samples that are consistent with this value occur with equal frequency and are specifiable as 
follows : (1, 3); (2, 3); (3, 3); (3, 2); (3, 1). This set of equally frequent values is the same 
for all values of s consistent with the specification x,, = 3. Thus we have suppressed no informa- 
tion about s by scoring our sample in this way. Is the same true of ху ? Let us now consider 
samples w.r.t. which ху. — 8. This specification is consistent with any value s > 4, but this 
condition does not suffice to specify what individual values x, and x, have. If s = 4 the only 
double sample consistent with the specification ху, = 8 is (4, 4). If = 5, three paired score 
values are allowable : (3, 5) (4, 4) (5, 3). If s = 6 we may have: (2, 6) (3, 5) (4, 4) (5, 3) (6, 2). 
"Thus we can say more about s, if we know the individual score of x, and x, than we can if we know 
only the value of the insu ficient statistic x,» ; but the individual values of x, and x, tell us no more 
than we already know, if told the value of the sufficient statistic xm. 

We have now to state the definition of a sufficient statistic formally. To do so we first 
remind ourselves that to each 2-fold sample specified in terms of the sequence of unit samples 
we may assign as above a bivariate score, e.g. (3, 5) or (5, 3). We may then speak of Р,,., as 
the unconditional probability that any sample has the bivariate score (ху, x») and Р,,.„ as the 
conditional probability that it has this score if x,, is the maximum score. In the same sense, 
we may label the unconditional probability of a multivariate score (ху, xs, Xs, . . . x) definitive 
of an r-fold sample as Piy.2.3...,).» for a distribution whose definitive parameter is p and 
Pa... 0,5 88 its conditional probability when the sample statistic is x, if we can define it 
from our knowledge of х alone. We may then define by Р,„.„ the probability that the sample 
statistic will be « if the parameter is p and obtain by recourse to the product rule 

Pas... n.» = Р,.›. Ру... nee 
We have now split the unconditional probability of getting the bivariate score which summarises 
all the information the sample supplies into two factors one of which is independent of p if the 
statistic is sufficient, i.e. if (as is true of Р,..„) we can specify it without knowing the value 
of the universe parameter. We thus take as our formal criterion of a sufficient statistic the 
resolution of the probability of the multivariate score into two factors of which one does not 
contain р. 

By recourse to a simple chessboard lay-out of s* cells with border scores from x = 1 to 
x = inclusive and x = 1 to x = s inclusive we may amplify this breakdown w.r.t. Xm and x; 
for the discrete rectangular universe. Each cell of the grid is referable to a unique pair of values 
x = x, and x = x, but the same value of t = (x, + x) or of Xm = m is assignable to more than 
one cell if ? = 2. Cells specified by х„ = т lie on two sides of a square of m cells, there being 
(2m — 1) in all. If we write Р,,., for the probability that the sample records the unique pair 
of score values x, and x, when the number of sectors is s, Р,,.„ for the probability that 
x has these two values when x,, = m and P,,., for the probability that x,, = m when s is the 
number of sectors, we thus see that 


1 1 2m — 1 


Passa Pug Py 


Im 1° s 
Hence in accordance with the product rule for conditional probabilities 
Ру}, = Pun Pms 


We have thus split the probability assignable to the bivariate score х, x, into two factors one of 
which (P;,.,) is independent of s; and we might be tempted to think that we could specify 
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a corresponding identity Р,,., = Р,,.,. Pi., referable to the probabilities of getting the score 
sum ¢ when there are s factors and getting the particular value of the bivariate score if also 
(x, + хз) has the particular value ¢. Actually we cannot do so. All samples such that 
(х + х) = tlie in a diagonal of (t — 1) cells if s > (2 — 1); and if we knew this we might write 
Py. = (t — 1)7 which is again independent of ғ. Thus there will be 4 cells in the diagonal 
corresponding to t = 5 if s > 4; but there will be only 2 cells in it if s = 3. Given t we can 
say that s > 34, e.g. s > 2 if t = 5, but we cannot say that ғ > (t — 1). The mere fact that 
t == 5 is therefore insufficient to assign a unique value to the conditional probability P.: 

In the same sense we may speak of the number (x) of successes in an r-fold sample from 
an infinite 2-class universe as a sufficient statistic of the parameter p. We may denote by 
Pi1.2.3...r)» the probability that the sample records successes and failures in a fixed order, 
there being 7;,, different samples so distinguishable for the particular value x. Thus we may 
write 


1 
Panno = р"; Pas... ; Р.„=тльр"@"; 


Tin 


Pass... 0.5 = Pan... n.i Ру.у. 


One circumstance which gives the concept of sufficiency a peculiar importance vis-à-vis 
Fisher's approach to the problem of interval estimation is that it is not always possible to specify 
a sample by a statistic which is sufficient in his sense of the term. Since the fiducial probability 
distribution is in his formulation referable only to sufficient statistics and only to sufficient 
statistics themselves referable to continuous distributions, the fiducial theory of interval estimation 
is of much more limited application on its own terms than is Neyman's theory of confidence. 


20.08 THE CLAIMS or SMALL SAMPLE THEORY 


En passant in 20.03 (p. 859) and more explicitly at the end of 20.04, we have had occasion to 
emphasise an essential difference between the Yule-Fisher interpretation of test procedure in 
terms of significance and the Neyman-Pearson-Wald approach in terms of decision. More 
explicitly, we may distinguish between a test procedure of the latter type as one designed to 
give a yes-or-no answer and an alternative prescription of which the only decisive outcome with 
an assignable uncertainty safeguard is the negation of a particular hypothesis. Purists of the 
Yule-Fisher school may therefore say that their test prescription excludes the possibility of 
making an error of the second kind. We shall now seek to clarify the limitations this renunciation 
imposes on the laboratory or field worker. 

For three decades, we have learned to think of economy of sample size as a prior desideratum 
of test procedure and to envisage their applicability to small samples as the supreme merit of the 
type of significance test dealt within Chapter 17. Whatever else of lasting value emerges from 
the Neyman-Pearson concept of test power, it is clear that we must now re-examine any such 
claims without confusing what is a purely algebraic with what is wholly a logical issue. Since 
the practical objective of a test procedure is to arrive at a decision of some sort, we must indeed 
distinguish between the adequacy of a statistical technique : (a) to assign a precise uncertainty 
safeguard to whatever positive assertion it entitles us to make with the minimum expenditure 
of effort; (b) to give a decisive answer to a particular question with the utmost economy of 
materials. No one could now question that the class of tests prescribed by the school of R. A. 
Fisher are economical in terms of (a), e.g. within the same framework of initial assumptions about 
the structure of the parent universe the t-test permits us to assign a more precise uncertainty 
safeguard than a c-test to the decisive assertion that the null hypothesis is false unless the sample 
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is very large. That this is so, does not dispose of a possibility of more concern to the research 
worker, We achieve no economy by using small samples if our test procedure сап assign no 
uncertainty safeguard to the majority of statements it leads us to make, i.e. if the overwhelming 
majority of permissible verdicts consistent with the choice of a false one as our null hypothesis 
are unproven. 

Against the background of 20.04, we cannot disclaim the obligation to examine this possibility; 
and may do so without invoking ary sophisticated mathematics. It will suffice if we take a 
back-stage view of the mechanism of the significance test for a proportionate score difference, or 
so-called Chi-Square test for 1 d.f., in the taxonomic domain. We shall postulate р, and p, as 
the true success rates for two treatment procedures (A and B), denoting by р,., and p». s 
the corresponding success observed rates for equal (r-fold) samples. If we write for brevity 
(Po — p.) = d and (py. — p...) = ds, we may then define without appreciable error for sizeable 
samples (e.g. ғ = 50) and for values of р, or р, in the neighbourhood of 0'5, a square normal 
standard score of unit variance by the relations 


(d, — 4)! Рада + Po t 
ё = E and o; ^ () 


For heuristic purposes we may assume that we know the true value of р, = 0^5 for the yardstick 

treatment (4), in which event 

1—24 
2r 


(ii) 


If we adopt the conventionally prescribed null hypothesis d < 0, i.e. that treatment Bis 
no better than treatment А, we may define for d = 0 our standard score in accordance with (i) 
and (ii) above as с, = d, /2r. Whence for equal samples r = 50, с, = 10d,. To assign an 
uncertain safeguard ж < 0-05 to the rejection of the hypothesis, we must make c = + 164 at 
the rejection level ; and we shall then reject the null hypothesis only if d, > +0164. 

"That the probability of falsely rejecting a hypothesis which is in any event irrelevant to our 
practical aim does not exceed 5 per cent. will give us little reason for satisfaction if the same 
rejection criterion commonly leads us to an indecisive verdict when another—and maybe more 
relevant—hypothesis happens to be true. ‘Taking a backstage view, we shall therefore suppose 
that we know treatment В to be at least 10 per cent. better than treatment А, i.e. the true hypo- 
thesis is d = 0-1. We shall thus define a standard score for d = 0'1 in terms of (i) and (ii) 


when r = 50 as 
. ld, — 01) 
Voss C 
We then recall that we have decided to teject the null hypothesis (d <0) if d, > 0-164, i.e. if 


of = 


e 


са > or а > + 0:65. 


0:64 
098 
We are now in a position to answer the question we have raised above. We wish to know how 
often the conventional null hypothesis (d — 0) would lead us to suspend judgment when the 
truth is that d = 0-1. This is simply definable in terms of the area of the normal integral of 
unit variance in the range from c, = — оо to c; = + 0°65, і.е. 


1 (9% 
| еі“ dc = 0:74. 


Ут) ә 
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"Thus the conventional null hypothesis test (at 5 per cent. significance level) will fail to result in a 
decision to reject it when the true operational advantage of treatment B is 10 per cent. in roughly 
75 per cent. of the situations we shall encounter; and the choice of a more exacting criterion of 
rejection will merely worsen our plight. We can guarantee with higher frequency a decisive 
statement, i.e. rejection of the prescribed null hypothesis (d < 0) for the same conditions stated 
(d = 0 and р, = 05) with an uncertainty safeguard х < 0-05, only if we increase r thereby 
diminishing our rejection criterion @,. In short we can evade the sin of committing the error of 
the second kind only by incurring the risk of suspending judgment in most applications of the test 
procedure. If we wish to guarantee that 95 per cent. of our tests will lead us to a decisive con- 
clusion, we have to adopt the dual test procedure of equalising the two risks (x = 0:05 = В) 
under a different name ; but we can do this only by prescribing sample size in conformity with the 
requirements of an admissible alternative hypothesis. 

The present position is therefore this. The several criteria of excellence (consistency, 
efficiency and sufficiency) claimed for now commonly used significance tests referable to a unique 
null hypothesis are economical only in a special sense with little relevance to the main concern 
of the research worker, i.e. to attach an uncertainty safeguard to a clear-cut decision. What is 
equally relevant to the contemporary revaluation of current practice is that the preference for 
sufficient and efficient statistics limits our choice of a null hypothesis to what a restricted range of 
sampling distributions can accomplish, and hence to the formulation of the null hypothesis in 
terms which may have no relevance to operational intention. Indeed, we may sum up the argu- 
ment of 20.03-20.04 by saying that the examination of small samples in terms of the now most 
widely used test procedures invoking a single null hypothesis will lead to answers of only two 
sorts—one non-committal, the other quite often immaterial. Unless we examine the situation 
through the spectacles of the dual test procedure, we have no guarantee that the test performance 
in the overwhelming majority of situations will not lead to a non-committal answer, i.e. to no 
answer at all. 


20.00 Tue SHow Must Go On 


In the foreword to Vol. I of Chance and Choice the writer expressed the view that increasing 
demand for instruction in statistical techniques must encourage authoritarian attitudes in higher 
education unless there is a more lively recognition of the need for simple exposition of the logical 
assumptions inherent in the mathematical derivation of statistical procedures in common use. 
The new concepts discussed in this chapter offer the prospect of a radical re-examination of 
their credentials, and a challenge to which the conscientious teacher will respond. The time 
for revaluation is overdue, and in one sense, therefore, it is a most encouraging sign of our time 
that the basic concepts of statistical theory are in the melting pot. Meanwhile, it has what 
may be discouraging consequences to the student confronted with contradictory assertions at 
the most elementary level in current text books. 

Until the publication of two recent books,* Wald’s (1947) Sequential Analysis and Neyman’s 
(1950) First Course in Probability and Statistics, much of the subject matter of this chapter was 
accessible only in highly abstruse mathematical publications. Inevitably, therefore, there are as 
yet few who have fully assimilated the logical implications of the new concepts discussed in this 
context. By the same token, the teacher who does not confine his or her theme to the exposition 
of one corpus of current dogma will find that his or her own views undergo modification under 
the impact of recent advances in statistical theory. This is conspicuously true of Kendall's 
invaluable treatise. In a rapidly and otherwise hopefully changing milieu, inconsistencies of 


* Also Feller’s (1950) first volume of an Introduction to Probability Theory and its Applications. 


SECOND THOUGHTS ON SIGNIFICANCE 909 


statement in the writing of a book such as Chance and Choice have also been inescapable, For 
instance, the views expressed in 20.03 are inconsistent with that expressed on pp. 96-99 of 
Chapter 2 in Vol. I; and the idiom of pp. 212-215 of Chapter 5 in Vol. I is not consistent with 
the more careful statement of the same issue in 20.05. 

By employing visual aids to exhibit the formal algebra of the classical theory of probability 
as in Vol. I and the derivation of the more widely used sampling distributions invoked by current 
statistical procedures as in this volume, the writer hopes that the outcome will be helpful to 
research workers hitherto hesitant to examine factual implications of statistical theory too long 
concealed by a façade of—to most of us—formidable mathematical operations ; and if the method 
of exposition proves to be useful to teachers who are themselves seeking to formulate the creden- 
tials of statistical theory in a less authoritative temper than that of their forerunners, the effort 
of completing a self-imposed task will not have been wholly fruitless. None the less, he retires 
from the stage with the misgiving that the issues raised in the controversy between the schools 
of R. A. Fisher on the one hand and of Neyman, Wald and E. S. Pearson on the other will in 
retrospect appear to be far more challenging than the last few pages may suggest. 

In retracing our steps with Neyman to the milieu in which the Founding Fathers set out to 
frame rules for the division of stakes to ensure success to the gambler who pursues any such 
rule consistently, we can interpret the risk of erroneous judgment only in terms consistent with 
a forward look. The risk we specify as our uncertainty safeguard is the risk of error associated 
only with the entire class of statements subsumed in a rule which we must state in advance. The 
reinstatement of the classical viewpoint thus deprives us of any right to associate a probability 
with a particular statement referable to a particular event, least of all to an event in the past. 
What is less obvious and has been emphasised too little in the foregoing pages is that a rule 
meaningfully so conceived must assign in advance the number of unit trials per game, i.e. the 
size of the sample. Thus the attractive algebraic properties which endow such distributions 
as the t- and the F- with a special claim to exactitude in one sense fail to confer on them the more 
exacting claims of a consistently forward look, 

1f we adopt a behaviourist viewpoint to the proper uses of the algebraic theory of probability, 
we must repudiate any concepts referable to indefinable states of mind, restricting the terms of 
reference of the theory in the real world of human experience to long-run frequencies of events 
and statements about events in situations to which the stochastic calculus has a relevance endorsed 
by empirical evidence. To realise all the consequences of this reorientation, we shall then 
need to equip ourselves with a new vocabulary; and much of the phraseology of this chapter 
will prove to be exceptionable if we undertake to reinterpret the legitimate scope of a calculus 
of judgments in an idiom consistent with the doctrine of chance in the setting of Pascal, J. 
Bernoulli and D'Alembert. 

So far as we can now foresee, such a restatement will extensively restrict the licence to 
invoke stochastic considerations in situations of which we cannot with full assurance postulate 
randomness sensu stricto. It will also restrict the form our statements can take when we are 
dealing with choice on which we impose randomisation by recipe. If we follow to the bitter 
end the trail which the new American school has blazed, we may therefore have to relinquish 
many hitherto cherished illusions concerning what help statistical theory can offer to the research 
worker. Such, as yet but dimly recognised, implications of the reorientation in which they 
invite us to participate sufficiently accounts for the unpalatability of their views. For my part, 
I am content to express the hope that the reader will face the challenge ; and, if convinced that 
a transvaluation of statistical theory is overdue, accept what limitations intellectual rectitude 
imposes on its claims with cheerful resignation. 


APPENDIX 1 
CHOICE OF SYMBOLS 


IN this volume I have employed some symbolic conventions which the reader will not find in 
use elsewhere, and it is fitting to add a few comments thereon. In general, algebraic symbolism 
advantageously conforms to the following requirements : (i) it should be evocative in the sense 
that its form is suggestive of its meaning either by consistent acceptance of arbitrary conventions 
or by literal association with the meaningful content ; (ii) it should be as explicit as necessary 
in the context without being more cumbersome than need be. Neither of these desiderata is 
realisable without compromise in certain situations. 

For instance, some writers use S, as shorthand for the sum of m terms and S; for the sum 
of the squares of z terms, when the latter form at its face value would suggest the square of the 
sum of n terms. One might write S,, or S, for the latter, employing q to indicate the quadratic 
term, thereby exposing oneself to misunderstanding at another level, since S,, or Sen might 
mean the sum of ng terms. The alternative S, would be cumbersome both from a semantic 
and from a typographic viewpoint. In such situations, I have deliberately defined a symbol 
ad hoc (e.g. S, on p. 495), regardless of its evocative content or of established usage. 

As regards (i), I have deliberately used л and r respectively for size of universe and size of 
sample, because the student is familiar with this convention in the domain of permutations 
and combinations ; and I have used subscript notation more extensively than do many teachers 
of the elements of statistical theory because the reference is easy to recognise or to remember 
by recourse to the initial letter of the appropriate epithet. Thus M, for the true value of the 
universe mean and M, for a sample mean are self-explanatory, if one commonly uses the sub- 
scripts ¢ and s in this sense. For labelling cells (p. 409) of the chessboard diagram, I have not 
adhered to the matrix convention x,, for the score referable to the rth row and the cth column. 
Throughout this volume, the particular cell score x;; signifies that of column i and of row j. 
The general term x,, means a score in a column of r cells and in a row of c cells. If this offends 
a purist, I plead in extenuation that : (a) the chessboard is not a matrix in the ordinary sense of 
the term ; (b) I have avoided recourse to matrix operations on the assumption that many readers 
with sufficient knowledge of differential calculus for understanding the book as a whole are not 
familiar therewith. Absolute uniformity is alas unattainable while current instruction condones 
sin . a for arc sin. а in conformity with the standard convention for inverse operations, but 
sin" .a = (sin. а)". Similarly, we still use antilog, . a where log; . a would be more in keeping 
with general usage. 

With reference to (ii) above, I wish to emphasise that algebra endorses by general consent 
a compromise common to all communication. One cannot steer a middle course between being 
too vague and being too long-winded if one repudiates the right to rely on context where context 
suffices to clarify meaning. My extensive use of the dot subscript symbolism (e.g. E,.,.) to 
distinguish operations referable to different dimensions is an attempt to avoid ambiguities which 
arise by leaving too much to context, and is consistent with an established convention of multiple 
regression and partial correlation. Some such convention is indispensable as a steering device 
through the maze of symbols invoked in the treatment of regression, of non-replacement sampling, 
and of patterns of variance analysis involving more than 2 dimensions of classification ; but 
I have not hesitated to drop it when I regard its unwieldiness as a handicap in a sufficiently 
explicit context. 

If I have sometimes used more explicit symbols than the context requires, it may perhaps 
have the advantage that it prepares the reader for their use when truly essential at a later stage. 
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For example, M(V.) for the mean of the variance of the distribution of scores within the columns 
of a 2-way grid should more explicitly be EV;.;) in conformity with the conventions con- 
sistently used in the treatment of a 3-way grid. Similarly, M, for the mean of the ith column 
is more explicitly represented by M;.;; and when one actually substitutes numerical values 
for j and i in such context the more explicit convention is an indispensable safeguard against 
ambiguity. Some inconsistencies of this sort have arisen because the need for such safeguards 
was less apparent at an early stage than later in the course. Thus in some figures set up as 
wall charts at an early stage (e.g. Fig. 89) I rely on the order of the subscripts to convey the 
correct dimension of an operation without recourse to the dot notation. 


APPENDIX 2 
THE METHOD OF LEAST SQUARES 


Tue method of least Squares dates from Legendre and Laplace in the second decade of the 
nineteenth century ; but it was Gauss whose writings first familiarised physicists with its use. 
Gauss gives a derivation in a memoir written in classical Latin (1821) and, perhaps for that 
reason, the rationale cited in standard works on the combination of observations follows the 
line of thought of Laplace rather than of Gauss himself. As emphasised recently by Plackett 
(Biometrika, 1949), the theorem of least squares established by Gauss is substantially equivalent 
to the theorem commonly associated with the name of Markoff (1912). It does not presuppose 
a normal—or any other—distribution of errors, and it makes no appeal to the highly arbitrary 
axiom that the best estimate of the unknown parameter is that value which would assign the 
highest probability to the observations. 

The method itself takes its origin from the need for some agreement about how to weight 
different observations which lead to inconsistent estimates of an unknown quantity. Gauss lays 
down the principle that the preferable estimate of the latter shall be the unbiased estimate whose 
sample distribution has minimal variance. If there are many sets of observations the derivation 
of the estimator with this property involves many sets of equations. It is therefore impracticable 
to exhibit the proof as applied to a specific problem involving combination of observations in its 
most general form without recourse to matrix algebra; but the pattern of the proof is easy to 
illustrate by recourse to a situation in which only 3 sets of paired observations are available for 
the determination of a single parameter such as the so-called simple regression coefficient, or 
the slope constant (k) of a linear physical law, i.e. 


у= +С 1 = z ` 3 ; (i) 
We shall here assume that we have three observation equations each involving an error, 
є, 6 OF єз: 
ah +С – 
Ya = kxy +C — € 
Уз =kx +C — € 
We also assume that the selected fixed values of x1, xs, хз are not subject to error or, what comes 
to the same thing, that errors to which y, and x, are subject are additive. On this understanding 
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we wish to weight Уу, ys, ys so that the derived estimate (k,) of k is unbiased with minimum 
variance. Thus we initially postulate k, as a weighted average of Nes 

k, = Илу, + Ways + Ways o. 2 А 0 ae nin) 
If our estimator is unbiased E(k,) = k, 


r=3 
ORE) + WEO) + WEO) =k 5 WEO) -G 
In this equation P 
WE) = Wiks, +WiC-WEe) . 0. . . (w 
On the assumption that the true value of y, is the mean of an indefinitely large number of observed 
values y, . „ the mean value of the error terms in (iv) is zero, i.e. E(e,) = 0, so that 
W,E(y,) = W,kx, + W,C, 


r=3 r=3 r=3 
> У WEG) =k > и, СУ Wn 
r= r= r=1 
To satisfy (ii) and hence the condition that А, is an unbiased estimator we must make 
r=3 r=3 
2We=1 nd $HW,-0 . . . . (y 
т=1 т=1 
Моге fully we may write these equations as 
Wy, + Wy, + Wax, —1 and W,+W,+W,=0 З « (xi) 
Hence also Wy, + Wor, + Wax, = 0 = Ила + Их + Waxy 
80 that m= 1 — Wan + Wis and И, = 1— Wis + Wis (vii) 
a — 4% “=y 


Equation (vii) thus defines the relations between the weights И, Wa, Wa in (ii) and the 
chosen fixed values ху, xs, xs consistent with the condition that А, is an unbiased estimator of k. 
To say that it has minimal variance is to say that V}. , = E(k, — К)? is as small as possible. 
Now we may define the sampling variance of V,., in accordance with (ii) in terms of the 
variances (от) of the distribution of the values y,., of y associated with a fixed value (x,) of 


х, viz. 
Vr. = Йот + Wioi + Ио. 
Our assumption is that у,., = y, + e,. „ i.e. the variance of y,., depends only on that (o2) of 
the error distribution which is independent of y. Thus o? = o2 = ах =o, 
os Ve. = (W + We + We. 5 : Д - (viii) 
To choose our weights W;, Wa, W; so that Vp., will be a minimum, we must satisfy the 


condition 
ШАК Wee MA. 


ie ae W, =0 = A ó AREE) 
We thus obtain from (viii) : 
(Wi (Wi WW; | д 
ЭЙ, ТЭИ ae ES > noB 
It suffices to evaluate this for W, = Wy so that 
+ Wee pu E. va 


oW, WV, 
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We derive from (vii) : 


W. dW, _ (1 — Их, + Wyxs)(%3 —2), 
ъй, (xy — хз)? ш 

ПАШЕ (1 — Wi, + И) (х — x), 
W, (xy — хз)? 


On substituting these values in (xi) we get 
(xs — x3) W, + (uy — x) (1 — Wix, + Wisa) + (xa — x) (1 — Их, + Иә) — 0, 
we 2И(хї + ai bap — xx, — ху — Nata) = 2x, — xy — xs E * © (xii) 
We can simplify (xii) by introducing M,, the mean value of x,, so that 
ЗМ. = ху + хз 1 хз and 3(x, — М,) —2x, — Xe — $9; 
З(х, — М.) + 3(x, — М.) + 3(xy — М.) = 2x} + xd + x3 — хуҗ — NNa — әд). 
Whence by substitution in (xii) : 


x, —M, 
(к — М.) + (х„— М.) + (s — М.) 
More generally for n paired values (y,, x,) we may write 


W, 


Л x,— M, 
È -My 
ral 
Whence by substitution in (ii) : 
ron 
È э — М.) 
kaii (xiii) 
Èe -My 
r-1 
We may express this relation in another form by using the substitution 
ran 
*»-.M, 


rel 
In (xiii) above 


тел 
Ide, — М.) = (у, — Mj, — М.) + Мух, – М.) and M, > (x, —M,) =0. 
rei 
Hence we may write (xiii) in the more familiar guise : 
> Or — Mj, — M) 
k, ==- 


т=п 


22 (x, — М.) 


INDEX 


(In compiling this index, key references only have been cited ; relevant cross-references are freely mentioned 
in the text.) 


Analysis of Covariance, 764, 771, 783 
Analysis of Variance, 407, 410, 448, 450, 455, 532 
Additive principle in, 554 
confidence limits, 681 
degrees of freedom, 572, 682 
for one criterion of classification, 569 
for two criteria of classification, 448, 533 
for three criteria of classification, 455, 543, 560 
interaction, 564 
model I and model II, 548, 731, 752 
replication, 556, 560 
significance tests, 669 
variance ratio, 655, 699 
Approximations, 45 
for factorials of large numbers, 237 
in solution of differential equations, 48 
in summation, 54 


Bayes’ postulate, 198, 206, 853 

theorem, 195, 849, 897 
Behrens test, 897 
Bernoulli’s theorem, 133, 147 
Bernoullian universe, 510, 514, 626, 897 
Beta function, 229, 251, 256, 646, 650 
Binomial distribution, 28, 37, 110, 229, 295, 594, 
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histogram, 110, 115, 223 
Bivariate universe, 326, 360, 428, 475, 714 
Burette universe, 607, 620, 827 


с-їезї (critical ratio), 127, 128, 148, 187, 192, 203, 
213, 303, 313, 323, 691, 699, 906 
Central difference, 116, 120, 230 
Chi-Square distribution, 217, 257, 263, 427, 612, 
644, 663, 665, 667, 670, 828, 833 
Classification, 60, 68 
criteria of, in analysis of variance, 533 
manifold, 428, 804, 828 
Co-moments, 808 
Co-prime samples, 169, 340 
Concomitant variation (see correlation), 326, 360, 
475, 482, 527, 528 
Concurrence, 326, 369, 384, 389, 400, 747, 750, 
784 
Confidence limits, 211, 213, 219, 695, 887 
theory, 859, 885, 897 
Consequence, 326, 369, 384, 389, 400, 748, 750, 
784 
Contingency grid, 429 
Correlation, 326 
in factor analysis, 784 
grid, 358, 429 
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Correlation—cont. 
and linear regression, 383, 388, 528 
multiple, 752 
partial, 390, 483, 527 
product-moment, 344, 349, 353 
rank, 331, 350 
ratio, 379, 441, 706 
tautologies of, 441 
umpire-bonus model in, 360 
universe, 476, 477 
Covariance, 344, 360 
addition of, 459 
analysis of, 764, 771, 783 
Curve-fitting, 110, 580, 595 
by method of moments, 232, 254 
and regression, 712, 746 


Decision test, 848 
Design of Experiments, 558, 783 
Difference distributions, 148, 153, 179, 183, 194, 
271, 290, 611, 825 
equation, 119 
Diophantine equation, 171 
Discriminant function, 759 
Distribution function, 230 
Double dichotomy, 880 


E-notation, 434, 453, 459 
Efficiency, 217, 294, 746 

Electivity, 75, 81, 91, 101 

Errors of first and second kind, 862 
Expectation fit, 581 


F-distribution, 653, 655, 699, 710, 740, 773, 783 
Factor Analysis, 784, 802 
attenuation, 791 
factor pattern, 785, 793, 795, 798 
hierarchical principle, 785 
reliability, 791 
saturation, 792 
umpire-bonus model in, 484, 487 
Fiducial distributions, 897 
limits, 213, 219 
Figurate series, 13 
in sampling, 65 
in summation, 462 
Fixed A-set, 714, 750 
Frequency grid, 407, 429, 432 
histogram, 110, 581, 636 
proportionate and relative, 101, 543 
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Gamma function, 229, 246, 251, 256, 589, 646, 660 
tabulation, 659 
Gregory’s formula, 33, 35, 52, 235 
Grid, 
contingency, 429 
correlation, 358, 429 
frequency, 407, 429 
independence, 439, 465 
regression in, 442 
score, 407, 410, 429, 448 
tautologies of, 428 
types of, 428 


Half-interval correction, 115, 116, 127 
Homogeneity, 453, 541, 897 

criteria of, 413, 543 
Homoscedasticity, 384, 480, 714, 721 
Hypergeometric distribution, 139, 230, 804 


Independence, 326, 331, 349, 635 
condition, 665 
grid, 439, 465 
Integration, 50, 234 
Interval Estimation, 886, 897 
Inverse probability, 199 


Leibnitz’ rule, 587 
Lexis models, 394, 508 
Likelihood, 197 


Maclaurin’s theorem, 35, 46, 234, 265 
Mean deviation, 231, 250 
Method of least squares, 713, 746, Appendix II 
Modular likelihood, 204, 340, 845, 863 
Moments, 229, 579 

as descriptive parameters, 231 

as gamma functions, 250 

derivation of, 582 

factorial, 591, 804 

generating functions, 264, 465, 582, 601 

of Bernoullian universe, 626 

of binomial distribution, 594 

of chi-square distribution, 833 

of difference distribution, 271, 611 

of distribution of the mean, 602 

of normal distribution, 595 

of Poisson distribution, 592 

of rectangular distribution, 593 

of score-sum distribution, 807 
Multinomial theorem, 39, 42, 79, 809 


Necessary and Sufficient Conditions, 528 
Non-replacement distribution, 137, 490, 814, 825 
Normal distribution, 115, 127, 139, 230, 250, 279, 
294, 317, 427, 595 
approximations to, 616 
Null hypothesis, 96, 105, 143, 153, 187, 205, 207, 
840, 859 


Ordinate fit, 581 
Orthogonal transformation, 520, 674 


Paired differences, 312, 630, 691 
c-test for, 313 
t-test for, 313, 704 ° 
Pascal's triangle, 25, 66 
Pearson system, 254, 427, 634, 646 
Pearson's coefficients, 232, 254, 342, 593, 604, 634, 
821 
of binomial distribution, 605 
of burette universe, 607 
of Poisson distribution, 605 
of rectangular distribution, 605 
Poisson distribution, 136, 223, 403 
moments, 592 
Pearson coefficients, 605 
Posterior probability, 197, 852 
Prior probability, 195, 197, 206, 852, 867 
Probability density, 183, 636 
generating function, 465, 467 
integral, 127 
Probable error, 204, 659 


Quality Control, 842 


Rectangular distribution, 255, 261, 280 
moments, 593 
Pearson’s coefficients, 605 
Regression, 377, 528, 712, 764 
as standardising device, 767 
coefficients, 383, 388, 442 
equation, computation for, 726 
estimates, 728, 740, 756 
linear, 377, 289, 442, 485, 492, 501, 505, 527, 
765 
multiple, 752 
Rigour, 580 


Sampling, 58, 394, 428 
classified, 68 
distributions, 148, 153, 166, 535, 634, 642 
from different universes, 294, 625 
models, 59 
randomisation, 62, 94 
restrictive and repetitive, 71 
size, and significance, 218, 906 
size, as a source of variation, 517 
without replacement, 71, 508, 804, 814 
Score-grid, 407, 410, 430 
summarising indices, 448 
symbolism, 448 
tautologies, 448, 532 
three-dimensional, 452 
Scoring, taxonomic and representative, 194, 275, 
490, 494, 533, 536, 814, 828 
Sequential ratio, 849, 854, 880 
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Significance, 104, 105, 108, 195, 222, 840 
and sample size, 218, 906 
test, 105, 148, 187, 203, 275, 579, 634, 848, 906 
for analysis of variance, 669, 706 
for regression estimates, 734, 740, 759 


Standard score (see Critical ratio), 128, 526, 598, 
830 
Standardisation, 767 
Statistical estimation, 307, 840, 885, 897 
inference, 840 
conditional and unconditional, 841, 885 
i ion, 842 
Stirling's formula, 46, 47, 234, 240, 242 
Stochastic credibility, 872 
Stringency, 872 
Sufficiency, 528, 904 
Summarisation, 
algorithms of, 427 
correlation coefficient in, 351, 360, 530 
Symmetrical distributions, 472 


t-test, 325, 427, 655, 665, 692, 783, 906 
for paired differences, 704 
Tchebychev’s theorem, 134 


Test power, 873 
procedures, 840, 859, 871, 880, 906 
"Therapeutic trial, 312, 840, 859, 874, 877 


Umpire-bonus model, 360, 481, 520 
algebraic properties, 385 
and factor analysis, 786 
and partial correlation, 390 
unrestricted, 372 
Uncertainty safeguard, 840, 852 
Unit sampling distribution, 278, 536 
univariate and bivariate, 477 


Vandermonde's theorem, 37, 299 
Vanishing triangle, 31 
Variance, 120, 132, 230 
analysis of, 532, 669 
balance sheet, 411, 535, 547, 560 
explained and unexplained, 369, 370, 383, 388, 
389, 400, 500, 514 
interclass and intraclass, 369, 395 
of a difference, 174 
of non-replacement distribution, 137 
of regression coefficient, 734 
partition of, 394 
Vector likelihood, 204, 340, 845, 863 


Wallis product, 240 


